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ABSTRACT 


This  research  program  centers  on  the  investigation  of  a  new 
optical /electronic  method  for  highspeed  convolution  and  correla¬ 
tion  of  two-dimensional  imagery.  The  method,  based  on  frequency- 
division  multiplexing  of  image  samples,  is  suited  to  implementa¬ 
tion  with  wideband  acoustooptic  devices.  During  the  report  pe¬ 
riod  the  following  has  been  accomplished: 

1.  Development  of  a  time-integration  method  for  obtaining  image 
output. 

2.  Development  of  methods  for  production  of  improved  encoding¬ 
decoding  local  oscillator  distributions. 

3.  Development  of  a  general  Fourier  transform  scanning  hybrid 
image  processor  concept. 

4.  Development  of  important  analogies  between  space-frequency 
conversion  image  processing,  time-integration  folded  spec¬ 
trum  analysis,  and  Fourier  transform  holography. 

5.  Development  of  a  joint -transform  method  for  space— frequency 
conversion  image  processing. 

6.  Development  of  a  significant  method  for  increasing  dynamic 
range  in  time-integration  optical  processing. 

7.  Development  of  a  technique  for  reducing  electronic  system 
dynamic  range  requirements  for  space— frequency  conversion 
image  processing 

8.  Devised  methods  for  overcoming  nonlinear  phase  response 
characteristics  of  acoustooptic  cells  in  processing  systems. 

9.  Development  of  a  method  for  using  common-band  acoustooptic 
cells  in  time-integration  folded  spectrum  analysis. 

10.  Devised  a  method  for  overcoming  the  need  for  wideband  four — 
quadrant  electronic  multipliers  in  space-frequency  convei — 
si on  processing. 

11.  Developed  a  novel  holographic  beam  combiner  scheme  that 
facilitates  production  of  straight  sinusoidal  fringe  pat¬ 
terns. 


These  developments  enhance  greatly  the  prospects  that  the  space- 
frequency  conversion  scheme  can  be  satisfactorily  implemented  in 
a  wideband  image  processing  system. 
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SUMMARY  OF  RESULTS  AND  THEIR  SIGNIFICANCE 

This  research  program  has  centered  on  the  investigation  of  a 
new  method  for  highspeed  linear  space  invariant  processing — 
spatial  correlation  or  convolution— —of  2— D  imagery.  The  method 
is  based  on  a  frequency-division  multiplex  representation  of  a 
sampled  image,  where  each  spatial  sample  is  represented  by  a 
separate  temporal  frequency  carrier  whose  amplitude  and  phase  are 
governed  by  the  amplitude  and  phase  of  the  sample.  The  proces¬ 
sing  method  is  suited  to  implementation  using  wideband  acousto- 
optic  devices.  Major  objectives  of  the  research  have  been  (1)  a 
thorough  conceptual  and  analytical  understanding  of  the  method, 
and  (2)  sufficient  experimental  experience  to  provide  guidance 
for  possible  later  developmental  efforts  by  others. 

Many  of  the  basic  concepts  of  the  method  are  presented  in 
Ref.  Cll,  a  copy  of  which  is  attached.  Additional  detail  is 
presented  in  Refs.  C23,  currently  in  preparation,  C5],  and  1121. 
In  the  following  paragraphs  we  delineate  important  results  of  the 
research  program  and  their  significance. 


Conceptual  and  Analytical  In vest i oat ions; 

Devel op men t  of  a  time— integration  method  for  producing  image 
output:  When  this  research  was  proposed  it  appeared  that  output 
of  the  processed  image  would  require  the  use  of  a  2-D  spatial 
light  modulator  to  serve  as  an  interface  between  the  electrical 
signal  representation  of  the  output  image  and  the  image  itself 
[33.  In  one  of  the  most  significant  developments  of  this  program 
we  have  showed  how  acoustooptic  techniques  under  development  for 
real-time  folded  spectrum  analysis  C43  can  be  employed  for  uis- 
playing  output  imagery  in  real  time  Ell.  This  development  should 
allow  an  increase  in  image  processing  rate  by  roughly  two  orders 
of  magnitude,  up  from  TV  frame  rates  to  approx i matel y  100  times 
that  rate. 

Development  of  methods  for  BCadUS&ion  of  improved  encodjnq- 
decoding  local  oscillator  distribution :  The  encoding,  or  convef — 
sion,  of  a  2-D  input  image  distribution  to  a  frequency-division 
multiplex  signal  and  the  corresponding  output  conversion  back  to 
a  spatial  distribution  require  a  2-D  array  of  light  spots  that 
vary  in  intensity  sinusoidally  with  time,  each  spot  varying  at  a 
different  temporal  frequency.  Through  the  development  of  suit¬ 
able  mathematical  models,  we  have  been  able  to  specify  several 
modifications  of  existing  techniques  that  allow  the  production  of 
such  "local  oscillator"  distributions  with  improved  characteris¬ 
tics  153.  The  main  feature  of  these  modifications  is  a  sharp¬ 
ening  of  the  encoding  light  spots  and  an  attendant  reduction  in 
crosstalk  between  multiplexed  signal  components. 

QSYBlgBSBD^  Bf  EeUCi.BC  tCBQBfBCB  BBBQOLOB  BCa£BB»aC  C8QBBB&* 
In  the  course  of  looking  for  an  experimentally  simpler  way  of 
testing  the  basic  space-to-f requency  conversion  processing  con¬ 
cepts,  we  discovered  a  broad  new  class  of  real-time  image  proces- 
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sing  techniques  C63,  of  which  the  space-to-f requency  conversion 
scheme  is  a  member.  These  techniques,  referred  to  as  Fourier 
transform  scanning  image  processing  techniques,  rely  on  an  en¬ 
coding  of  the  magnitude  and  phase  of  a  given  spatial  frequency 
component  of  an  image  as  the  magnitude  and  phase  of  a  temporal 
frequency  carrier.  As  the  spatial  frequency  is  scanned,  a  com¬ 
plex  modulation  of  the  carrier  results.  Electronic  processing  of 
the  carrier  produces  a  modification  of  carrier  magnitude  and 
phase,  which  corresponds  to  multiplication  of  the  image  spatial 
frequency  spectrum  by  a  transfer  function. 

The  scheme  is  very  powerful  and  more  flexible  than  the 
space— to— frequency  conversion  scheme  (which  corresponds  to  the 
special  case  of  scanning  spatial  frequency  space  in  a  repeated 
falling  raster  format).  The  latter  scheme  is  still  quite  impor¬ 
tant,  however,  because  only  it  is  capable  of  fully  exploiting  the 
large  operational  bandwidth  of  acoustooptic  devices  in  image 
processing. 

Devel ooreent  of  an^lggiss  between  space— frequency  conversion 
image  processing.  tijge^i ntegrati on  foldgd  spectrum  aQ£l^gi.Si  and 
Fourier  transform  holography :  One  of  the  most  important  con¬ 
ceptual  /analytical  contributions  of  this  research  program  has 
been  the  development  of  useful  analogies  between  space— frequency 
conversion  processing,  space-  and  time-integration  folded  spec¬ 
trum  analysis,  and  Fourier  transform  holography.  These  analo¬ 
gies,  discussed  in  Ref.  C53,  have  helped  us  and  others  to  under¬ 
stand  the  limitations  and  possible  improvements  of  these  schemes, 
particularly  with  respect  to  the  signal -to— noise  ratio  of  the 
processed  outputs. 

Development  of  a  joint-transf orm  method  for  space-frequency 
conversion  image  processing:  One  of  the  more  widely  used  methods 
for  performing  spatial  correlations  with  coherent  optical  systems 
is  the  so-called  joint-transf orm  method,  wherein  both  distribu¬ 
tions  to  be  correlated  are  input  to  the  system  simultaneously  and 
a  square-law  device  effectively  multiplies  their  spatial  fre¬ 
quency  transforms.  We  have  shown  how  the  joint-transform  rcthoo 
can  be  implemented  in  a  space-frequency  conversion,  time— integra¬ 
tion  implementation  C23.  There  are  two  major  advantages  of  this 
method:  (1)  only  a  single  optical  system  need  be  used  for  both 
input  distributions — with  proper  design,  this  system  can,  in 
fact,  be  used  for  simultaneous  output  as  well;  and  (2)  the  joint- 
transform  approach  facilitates  essential  synchronization  of  input 
and  output  operations. 

BsgslBeseQt  q£  «  ®«thad  foe  LaccMii.au  dxaMic  range  to 
timer  in  tegrat  j.gn  optigal  grgggxci.ggi  One  of  the  serious  limita¬ 
tions  of  time-integration  optical  processing  is  the  buildup  of 
bias  in  the  output  plane  during  processing  C73.  Poor  dynamic 
range  arises  in  such  processing  because  each  momentary  contribu¬ 
tion  to  the  output  of  the  optical  processor  carries  with  it  its 
own  bias;  the  time-integrated  bias  uses  up  a  major  fraction  of 
the  available  dynamic  range  of  the  output  plane  detector.  Ex¬ 
ploiting  the  analogies  with  Fourier  transform  holography  noted 
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above,  we  have  described  a  scheme  for  reducing  this  output  plane 
bias  to  an  absolute  minimum  £83.  Computer  simulations  indicate 
that  the  method  allows  roughly  an  order  of  magnitude  increase  in 
processed  image  dynamic  range  for  TV— format  imagery  £83.  The 
importance  of  the  proposed  technique  extends  well  beyond  the 
image  processing  work  of  this  program,  for  it  is  applicable  to 
real-time  spectral  analysis  and  other  forms  of  signal  processing 
as  wel 1 . 

The  minimum  bias  scheme  described  in  Ref.  £83  requires  that 
the  electrical  signal  representing  the  processed  image  undergo  a 
square-root  operation.  Such  an  operation  cannot  be  performed 
accurately  on  wideband  signals,  and  thus  presented  a  serious 
bottleneck  for  rapid,  large  dynamic  range  processing.  On  close 
inspection,  however,  we  have  concluded  that  the  square  root 
operation,  necessary  to  assure  minimum-bias  output  plane  distri¬ 
butions  in  the  output  plane  with  the  proper  Fourier  magnitudes, 
is  not  essential  so  long  as  we  do  not  require  that  the  detected 
output  distribution  be  a  perfectly  faithful  representation  of  the 
processed  image.  In  particular,  a  logarithmic  operation,  easily 
performed  on  wideband  signals,  is  adequate  for  all  but  the  most 
demanding  application.  For  matched  filtering  operations  and  most 
image  processing  applications  the  resultant  output  will  be  little 
changed  from  the  ideal.  Details  are  provided  in  Ref.  £93. 

Reduction  of  electronic  systgm  dynjgig  range  requirements: 
In  the  original  proposal  it  was  noted  that  the  result  of  the 
space-to-f requency  conversion  was  an  electrical  signal  of  the 
form 


N 

g(t)  =  ^  gw<t)cos£2q(f#  +  raAf  >t3. 
m«=l 

This  signal  is  periodic  and  attains  a  maximum  whenever  the  argu¬ 
ment  of  the  cosine  equals  an  integer  multiple  of  2C  radians.  The 
dynamic  range  requirements  on  the  attendant  electrical  signal 
processing  subsystems  can  be  extreme,  and  we  consequently  ex¬ 
amined  a  variety  of  schemes  for  reducing  the  dynamic  range  of  the 
converter  output. 

It  was  ultimately  the  development  of  the  Fourier  scannina 
image  processor  concept  noted  above  that  led  to  a  solution.  In 
particular,  it  can  be  viewed  as  the  periodic  encoding  of  the  zero 
spatial  frequency  component  of  the  input  image  that  leads  to  the 
periodic  maximum  value  of  g(t).  The  solution  to  the  problem  is 
simple:  through  proper  design  of  the  optical  system  for  encoding 
the  input  image  it  is  possible  to  prevent  the  zero  spatial  fre¬ 
quency  component  from  being  encoded.  Since  this  component  genet — 
ally  conveys  no  useful  information  about  the  image  to  be  pro¬ 
cessed,  its  exclusion  does  not  adversely  affect  the  resultant 
output  image. 
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EsBscissQ&al  sod  Bsyiss  InysstiflatiaDgs 

Phasa  ebacasiacisiiES  s£  aseystseetiE  esIIs*  Early  in  our 
experimental  work  we  determined  that  the  phase  response  charac 
teri sties  of  acoustooptic  cells  would  complicate  system  develop¬ 
ment  immensely  if  different  cells  were  used  for  image  input  and 
image  output  systems.  The  problem,  basically,  is  that  the  phase 
of  an  acoustooptical 1 y  diffracted  light  wave  is  not  fixed  to  the 
phase  of  the  rf  input  signal,  but  rather  varies  as  a  function  of 
frequency  in  accord  with  the  transfer  characteristics  of  the 
particular  cell.  Two  solutions  were  developed: 

First,  in  discussions  with  Dr.  R.  Williamson  of  MIT  Lincoln 
Laboratories,  we  determined  that  SAW  chirp  generators  can  be 
fabricated  that  precompensate  the  phase  of  an  rf  chirp  as  a 
function  of  frequency.  If  a  properly  precompensated  chirp  is 
input  to  the  acoustooptic  cell,  the  result  is  a  diffracted  light 
wave  whose  optical  frequency  increases  linearly  with  time,  as 
desired. 

A  second  solution,  the  one  we  chose  for  our  experimental 
investigations,  requires  that  the  same  acoustooptic  cells  be  used 
both  for  input  of  the  two  distributions  to  be  convolved/corre¬ 
lated  and  for  output  of  the  resultant  processed  distribution. 
With  such  an  approach  it  is  possible  to  monitor  the  time-varying 
phase  of  the  diffracted  waves  and  employ  coherent  electronic 
signal  processing  techniques  to  compensate  far  any  drift.  This 
technique  also  allows  for  compensation  of  any  phase  drift  intro¬ 
duced  by  aberrations  and  motion  of  components  in  the  optical 
system. 

Use  of  c ommon ->? and  acoustoopti c  cells;  Early  in  our  re¬ 
search  it  appeared  that  acoustooptic  implementation  of  the  scheme 
would  require  the  use  of  two  acoustooptic  cells  that  operated  in 
widely  disperate  frequency  bands — one  for  a  slow  but  wideband 
scan,  the  other  for  a  rapid  but  smaller  bandwidth  scan.  One  of 
our  minor  achievements  in  this  research  was  the  discovery  of  a 
method  for  producing  the  required  array  of  sinusoidally  blinking 
light  spots  using  a  pair  of  acoustooptic  cells  that  operate  in 
essentially  the  same  temporal  frequency  band.  This  method,  des¬ 
cribed  briefly  in  Ref.  [53,  allows  implementation  of  the  space- 
frequency  processing  scheme  with  potentially  simpler  electronics. 

HighsQgeg  multielisr  QrgblsS*  Another  practical  problem 
addressed  during  this  research  program  was  that  of  implementing 
the  wideband  signal  multiplication  necessary  to  produce  the  elec¬ 
trical  signal  representing  the  processed  image.  The  operation 
requires  a  four -quadrant  multiplier  (i.e. ,  one  for  which  both 
input  signals  and  the  resultant  output  signal  can  be  bipolar) j 
unfortunately,  foui — quadrant  multipliers  with  the  required  accu¬ 
racy  are  limited  in  operational  bandwidth  to  tens  of  meg^hc.  Lz 
C103 — inadequate  for  our  purposes.  We  have  solved  this  problem 
on  paper  by  exploiting  the  bipolar  signal  multiplication  capabi¬ 
lities  of  the  acoustooptic  devices  themselves.  The  resultant 
scheme  is  similar  in  many  respects  to  the  triple-product  acous- 
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tooptic  processor  investigated  by  Kell man  et  al  with  AFOSR  sup¬ 
port  C 1 1 3  . 

Holographic  beam  combiner:  The  experimental  implementation 

we  chose  ~to~i n vest i gate  C63  required  that  we  produce  a  moving 
sinusoidal  fringe  pattern  incident  on  a  pair  of  image  transparen¬ 
cies.  The  spatial  frequency  of  the  fringes  is  changed  by  moving 
a  pair  of  galvanometer — mounted  mirrors  in  the  optical  system.  It 
is  essential  that  the  fringes  be  straight:  curved  fringes  corre¬ 
spond  to  a  blurring  of  image  information  in  spatial 
space.  In  order  to  assure  straightness  of  the  fringes  we  em¬ 
ployed  a  holographic  beam  combiner  technique  that  is,  to  our 
knowledge,  original.  The  basic  idea  involves  making  an  interfe- 
rogram  of  two  nominally  planar  waves  which  is  then  used  as  a 
diffracting  element  to  combine  these  two  waves.  When  functioning 
as  a  combiner,  the  interf erogram  diffracts  one  of  the  incident 
waves  and  reconstructs  a  replica  of  the  other.  The  diffracted 
wave  then  interferes  perfectly  with  the  original.  If  one  or  the 
other  wave  is  tilted  slightly  at  the  combiner,  the  result  is  a 
pattern  of  highly  regular  fringes,  as  desired.  The  only  require¬ 
ment  is  that  the  phase  aberrations  of  the  original  incident  waves 
not  be  too  great — say  limited  to  20  wavelengths  or  less.  We 
believe  that  this  scheme  should  facilitate  the  construction  of  a 
number  of  different  kinds  of  interferometric  optical  signal  pro¬ 
cessing  systems.  We  are  in  the  process  of  improving  our  holo¬ 
graphic  recording  techniques  and  hope  soon  to  publish  the  basic 
idea. 
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April  1979,  met  with  D.  Stillwell  of  NRL  and  P.  Kell man  of  ESL  to 
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Kell man  and  T.  Bader  of  ESL  and  J.  Cohen  of  NSA  on  time  integra¬ 
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Norman  Berg  of  Harry  Diamond  Laboratory,  generally  centering  on 
2-D  acoustooptic  signal  processing. 
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Optical  Signal  Processing,  lengthy  discussions  with  T.  Turpin  of 
NSA  on  the  generation  of  2— D  local  oscillator  distribution^  ror 
space-to-f requency  conversions. 

March  1981,  during  2-D  Signal  Processing  Symposium  at  Naval 
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Dr.  Todd  Bader  of  ESL,  and  Dr.  Theo  Kooij  of  DARPA. 
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Harper  Whitehouse  of  the  Naval  Ocean  Systems  Center,  Dr.  John 
Neff  of  AFOSR  (visiting  for  program  review),  and  Prof.  David 
Casasent  of  Carnegi e-Mel Ion  University. 

May  1981,  at  Woods  Hole  Symposium,  pro ject-related  interaction 
with  P.  Denzil  Stilwell  of  Naval  Research  Laboratory  and  Dr.  Theo 
Kooi j  of  DARPA. 

August  1981,  visit  to  Applied  Optics  Laboratory  at  University  of 
Erlangen  in  WEst  Germany  to  discuss  current  research  efforts  with 
Prof.  A.  W.  Lohmann;  visit  to  Applied  Physics  Laboratory  at 
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Bellingham,  1982;  Vol.  2  in  Advanced  Institute  Series). 


12 


Acousto-optic  devices  applied  to  image  processing 


William  T.  Rhodes 

Georgia  Institute  ot  Technology 
School  ot  Llectruul  1  ntjineerifuj 
Atlanta.  Gt'oiqra  TO.Ta.’ 


Abst rac t 


Iwi>  recently  reported  optical  process  ing  concepts  can  lie  exploited  ior  realtime  linear  shi  It- invar  iant  pro¬ 
cessing  ot  J-D  imagery  with  acoust oopi i c  devices:  (1)  space  coord inate- to- tempera l  frequency  conversion*  and 
(J)  t  itnc- integral  ion  spectral  analysis.  A  pair  oi  crossed  aenustoopt ic  cells,  driven  bv  periodic  chirp  wave¬ 
forms,  can  bi*  used  lor  both  operat  ions.  State-oi  -  the— art  aeons  Loopt  ic  devict'S  appear  suitable  for  gigahertz 
rate  processing  of  images  with  spacebandwid tli  products  approaching  10' . 

! n ( roduc t ion 


Acoustooplic  (AIM  devices  are  applied  regularly  to  the  analysis  and  processing  ol  1-1'  signal  waveforms  be¬ 
cause  they  a  I  low  realtime  conversion  oi  a  time  wavet orm  into  a  correspond ing  light  wave  amplitude  distribution 
(II.  They  have  been  mostly  disregarded  lor  image  processing  applications  (except  as  scanners  and  modulators) 
because  oi  their  inherently  one-d imens iona l  nature.  Although  a  pair  ol  AO  devices  might  be  crossed  to  produce 
a  limited  class  (e.g.,  separable  in  cartesian  coord i nates)  of  light  wave  distributions,  thev  cannot  play  the 
needed  role  ol  a  general,  electrically  addressed  J-I)  spatial  light  modulator.  There  is,  nonetheless,  a  wav  to 
exploit  tlie  attractive  features  ol  At)  l  eclmo  1  ogv--w  i  deband  operation,  no  moving  parts-- in  the  highspeed  proces¬ 
sing  ot  arbitrary  d-I)  imagery.  The  necessary  keys  to  this  exploitation  are  a  space  coord i nate- to- tempera  I  !  re¬ 
queue  v  mapping  or  conversion  we  recently  reported  [ |  and  a  new  class  of  AO  spectral  analvsis  operations  re¬ 
cently  described  bv  Kellm.m  and  hv  Turpin  | 


Our  overall  goal  i-.  a  hvbrid  »»pt  i  ea  1  -e  lee  t  ion  i  c  system  with  the  capabilities  suggested  by  Fig.  1. 
figure,  g(x,v;t)  is  a  time  v.irying  input  image,  a  limi  t  ion  of  spatial  coordinates  x,v,  and  of  time  t. 
sired  input-output  relationship  for  the  system  is  given  either  bv  a  spatial  convolution. 


In  this 
The  dc- 


f(x,y;t)  -  g(x,v;  t  )*li(  x,v  ;  t )  -  g(u,v; t )h(x-u,v-v; t  hludv. 


(1) 


or  bv  a  spatial  cross  correlation. 


f(x,y;t)  "  gf x, v; t )#h ( x ,y ; t ) 


1  .’.(ii ,  v ;  t  )h*  ( x-u  ,v-v ;  t  )  d Ik!  v . 

J 


iJ) 


where  we  have  allowed  icr  the  case  el  complex  valued  d is t r i hut  ions  by  including  a  complex  conjugation  in  the 
second  integral.  In  order  to  describe  the  basic  approach,  we  must  consider  four  major  concepts  (the  last  two 
of  which  are  closolv  related):  (1)  space  coord  i  n.i  t  e- to- 1  empora  l  frequency  mapp  ing.;  (.’ )  spatial  correlation  and 
convolution  via  waveform  mu  1 1 ip  1 i rut  ion ;  (U  AO  input  conversion;  and  (T)  AO  output  conversion  (display).  In 
thi*  following  sections  we  describe  these  basic  coin  *pts  ami  assess  their  implications  tor  highspeed  image  pro¬ 
cess  in  g. 

Space  loot'd  i  nat  e- l  o- 1  empora  I  Irequencp  tlonve  is  i  on 


The  first  concept  involves  a  reversible  mapping  or  encoding.  (Fig.  .’ )  ot  the  input  dist  r  ihut  ion , 
into  a  lime  waveform  g..(t)  via  an  i>rilerod  I  requeue  v-d  i  v  i  s  i  on  nui  1 1  i  p  I  ex  i  ng  operation:  t  lu*  time  timet  ion  fi  pi\  - 
sent  ing,  each  element  (pixel)  ol  (he  time  valving  image  modulates  a  dillerent  temper. il  •  tvquencv  currier.  Sole, 
rea  I -v.i  1  iii'il  ami  comp  1  ex-va  liu*tl  images  can  he  encoded.  Ana  I  vt  i  ca  1  I  v  ,  gj-(t)  is  describetl  bv  l  .q .  (M  below: 

N“ 

)•  (t)  -  >  H  U  ).os|.’n(l  +  mM  )  t  +  '•  (t)|.  O 

I  °  111 

l 

w’u  re 


K  U)  »  ,  x  ,v  ;i  )  , 
m  mm 

'  ( t  )  -  -i r f. {  «(x  ,  v  ;  l  )  ! . 
m  ni  m 


(*) 


C') 


In  Kqs.  (  '* )  ami  (>),  <  xm  •  vm ;  t  )  is  the  value  ot  g(x,v;t)  at 

array.  As  shown  in  Fig.  1,  thcsi  sample-,  are  ordered  in  a 
thus  represents  the  following:  The  input,  g(\,v;l).  assume 


the  mth  sample  location  in  a  regular  N 
lei  t -to-r  iglit  ,  t  op-t  o-hot  t  om  fashion, 
d  t.>  bo  ol  finite  spatial  bandwidth  and 


xN  sampling, 
(qua  lion  (O 
extent,  is 
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sampled  spatially.  By  assumption,  the  distance  between  samples  satisfies  the  Nyquist  sampling  condition.  Hu* 
magnitude  and  (if  complex-va lued)  phase  of  the  sample  value  at  the  mth  sample  location  are  given  by  gn(t)  and 
un,(L).  For  each  m,  gm(t)  and  0m(t  )  then  serve  to  modulate  the  magnitude  and  phase,  respectively,  of  a  cosine 
at  frequency  f m  =  f0+mAf.  The  output  of  the  space- to-f requency  encoder,  g^-(t),  which  equals  tin*  sum  ot  all 
such  modulated  carriers,  thus  represents  the  entire  NxN  image  array. 

So  long  as  the  temporal  frequency  bandwidth  of  each  term  in  the  summation  is  sufficiently  small  compared  to 
A  f ,  the  individual  terms  do  not  overlap  in  frequency  content,  and  gf(t)  is  an  unambiguous  representat ion 
(through  the  sampling  theorem)  of  g(x,y;t).  Specifically,  an  inverse  mapping  is  possible. 

Figure  s  illustrates  with  the  case  of  a  5x5  array  of  non-time  varying  image  samples,  for  convenience  as¬ 
sumed  to  be  nonnegative- real  and  of  integer  value.  The  spectrum  Gj-(f)  is  the  Fourier  transform  ot  gj(t).  If 
g(x,y;t)  varies  with  time,  the  discrete  spectral  components  shown  broaden  out  into  narrowband  components  (bv 
as sump t ion ,  non-over  lapping) . 

In  Kef.  1  we  noted  (as  have  others)  that  such  a  representation  provides  an  a  1  tern.it  i  ve  to  conventional 
scanned  signal  representations  tor  transmitting  images.  Our  interest  here  is  in  how  this  mapping  can  be  ap¬ 
plied  to  highspeed  image  processing,  as  we  discuss  in  the  following  section.  Later,  we  shall  return  to  the 
question  of  how  to  perform  the  space-to-f requenev  mapping. 

Spatial  Convolution  and  Correlation  Via  Waveform  Multiplication 

In  Fig.  5  we  show  in  diagram  form  a  system  suitable  for  real  time  convolution  or  correlation  of  a  pair  of 
input  images  or  other  spatial  distributions  represented  by  g(x,y;t)  and  h(x,y;t).  In  between  the  pair  of 
space- to-f requency  encoders  at  the  left  and  the  f requency-to-spnce  decoder  at  the  right — both  of  which  will  be 
described  later — the  system  consists  of  conventional  electronic  subsystems:  heterodyne  converters,  a  waveform 
multiplier,  and  a  bandpass  filter.  The  heterodyne  converters  simply  move  the  collection  of  modulated  carriers 
representing  g(x,v;t)  and  h(x,y;t)  up  or  down  in  frequency  as  a  group.  Thus 

gj-(t)  =  i  gm ( t ) cos 1 2 •» ( f ^  +  f i  +  mAf ) t  +  0m(t)|,  (6) 

where  f  ^  is  the  amount  of  frequency  shift.  Similarly  for  hj.(t)  and  h  ^  ( t )  - 

The  heart  of  the  system  is  the  mul t iplier.  Multiplication  of  two  time  waveforms  implies  convolution  ol 
the  corresponding  spectra.  But  in  this  case,  the  spectra  represent,  on  a  sample-by-sample  basis,  the  elements 
of  the  two  spatial  distributions  to  he  convolved.  It  is  a  consequence  of  the  particular  ordered  encoder  map¬ 
ping  chosen  that  convolution  of  the  two  spectra  corrospnds  to  a  convolution  (or  correlation,  deponoing  on  sys¬ 
tem  setup)  of  the  corresponding  2-D  spatial  distributions  g(x,y;t)  and  h(x,v;t). 

It  is  easiest  to  see  this  hv  considering  an  example,  in  this  case  a  convolution.  Let  the  two  arrays  in 
Fig.  b  represent  a  pair  of  sampled  image  intensity  distributions  g(x,v)  and  h(x,v),  assumed  to  bo  non-time 
varying.  The  actual  image  arrays  are  .1x1  in  extent,  hut  since  convolution  of  two  Ixl  arrays  yields  a  5x5 
array,  it  is  necessary  to  encode  g(x,v)  and  h(x,v)  in  larger  5x5  arrays  with  zeros  around  the  edge.  The  cor¬ 
responding  spectra  Gf(f)  and  Hf(f)  are  also  shown.  Assuming  the  frequency  offsets  tor  the  two  signals  to  he 
sufficiently  great,  multiplication  of  gf(i)  by  hj-(t)  produces  two  groups  ol  non-over  lapping  temporal  t  requenev 
components,  corresponding  to  sum  and  difference  frequencies.  The  sum  frequencies  are  shown  in  Fig.  7(a),  ob¬ 
tained  by  convolving  the  distributions  of  Figs.  6(c)  and  h(d).  These  components  are  isolated  by  the  bandpass 
filter  and  heterodyne-converted  down  in  frequency  for  decoding/display.  The  resultant  2-1)  output  distribution, 
obtained  according  to  the  inverse  of  the  mapping  of  Fig.  1,  has  sample  values  proportional  to  those  shown  in 
Fig.  7(h),  tile  di  sired  2-D  convolution.  It  is  easily  shown  that  the  difference  frequencies  generated  hv  the 
multiplication  correspond  to  the  cross  correlation  of  g(x,y)  with  h(x,y).  Thus  a  minor  change  in  bandpass 
filter  characteristics  allows  either  g(x,y )*h(x,y)  or  g(x ,y )* h (x, v )  to  be  obtained  as  output. 

Acoustooptic  Input  Conversion 

The  system  employed  for  encoding  an  input  2-D  distribution  as  a  frequency-division  multiplex  signal  wavt- 
forro  will  depend  in  form  on  whether  the  input  is  a  light  intensity  distribution  or  a  complex  wave  amplitude 
distribution.  We  consider  first  the  encoding  of  nonnegative  real  intensity  distributions,  then  note  modifica¬ 
tions  appropriate  for  complex  valued  amplitude  distributions. 

Assume  that  the  input  to  be  encoded,  g(x,y;t),  exists  as  the  light  intensity  transmittance  of  a  realtime 
spatial  light  modulator  (SLM) .  (Since  we  are  concerned  only  with  the  intensity  transmittance  of  the  SLM,  sur¬ 
face  quality  requirements  can  be  relaxed  from  those  necessary  for  coherent  optical  processing.)  The  basis  for 
the  encoding  operation  is  illustrated  in  Fig.  8,  where  we  show  the  mth  element  of  the  SLM  illuminated  bv  a 
focused  beam  of  light.  This  light  beam  is  modulated  sinusoidally  in  intensity  at  frequency  fm  *  f0  +  mAf,  as 
appropriate  for  sample  location  (x^Vj^).  Since  the  light  power  transmitted  by  the  SIJi  is  proport  ional  to 
gfx^.y^it),  the  output  of  the  photodetec  tor  contains  an  a.c.  term  proportional  to  g(xTn,ym;t),  where  uim=2T>fm. 

Obviously  what  Is  desired  is  an  array  of  light  beams,  NxN  in  extent,  with  all  beams  incident  on  the  SLM 
simultaneously  and  each  blinking  sinusoidally  at  a  rate  appropriate  to  the  spatial  element  it  illuminates. 
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Assuming  the  photodot  tv  tor  to  bo  sufficiently  l.rge  tliot  all  the  light  transmitted  by  the  SLM  is  eol  lee  tod, 
the  detector  output  will  then  contain  a  term  proportional  to  }  gm( t )eos( 2* (f„  +  mAf ) t  +  9nj(t)],  as  desired, 
for  this  case,  ^(t  ^  =  Vm» 1 )  *  «i»d  the  phase  angle  **m(t)  depends  on  the  relative  phase  of  the  i  1 1  umin.it  ing 

light  spot  variations. 

A  system  lor  producing  a  single  encoding  spot  at  blink  t  ivquenev  I  m  is  shown  in  fig.  9.  II.  n  an  Ao  cell  i- 
dr i ven  by  a  sinusoid  at  frequency  lm-  In  the  hack  local  plane  of  the  lens  the  +1  djl  traction  order  is  brought 
Lo  a  locus  at  the  nith  cell  of  the  S1.M,  where  it  mixes  witli  light  brought  around  bv  tin*  beamsplitter/mirror 
combination.  The  interaction  of  light  with  sound  in  the  AO  device  increases  the  optical  frequency  of  tin-  +1 
di ft  ruction  order  from  the  base  laser  frequency  (— SxlO  Hz)  by  an  amount  equal  to  f|1}.  Depending  on  tin*  AO 
device  used,  t  nj  may  range  1  rom  several  megahertz  to  several  gigahertz.  I'sing  phasor  representations  J  r)  |  tor 
the  two  mixing  wave  fields  (and  assuming  equal  amplitudes),  we  have  for  the  light  intensity  at  (xm,vm) 

I(x  ,v  )  -  I  +  »  2(1  +  cosJ "  t  t>.  (7) 

m  m  in 

which  is  ol  llu‘  desired  form. 

Multiple  spots  ol  light,  each  blinking,  at  a  diller.nl  ireqiiencv,  can  he  pro ’need  by  driving  the  AO  cell 
s  i  mu  1 1  ancons  l  \  kith  a  numhet  of  cosine  wavciornis,  each  at  a  dilferent  frequence.  The  diltractioii  anglo--and 
there!  ore  the  location  of  the  resultant  spot  in  the  encoding,  planer-will  depend  on  the  J  1'equency  *’t  the 
particular  wavotorm  component,  the  distance  ot  the  spot  from  the  optical  axis  he  tint  proport  iona  I  to  1^. 

Spec- i  f  i  i*a  l  1  v  ,  driving  tin*  AO  cell  with  signal  s  i  t  ) »'s  1  d  ( t  +  rn.'.t  )  t  |  will  produce  a  row  ol  equal  lv  spaced 
light  spots  separated  in  blink  frequency  bv  M.  Iligb  d  i  f  f  ra«  t  i  on  ell’icioney  is  not  possible  wi  tii  such  an 
input  signal  because  of  the  ini)<rcnt  non  1  i  near  i  t  i  os  ol  the  AO  ini  t  me  t  i  on.  It  is  possible,  however,  to  obtain 
a  time  varving  wave  intensity  ol  the  desired  i  arm  at  the  sample  loe.it  ions  hv  dr*vin“  the  cell  with  a  period:* 
chirp  waveform,  where  tin-  frequency  of  the  input  sinusoid  is  ramped  linearlv  will)  time  in  a  repetitive  manner 
| h 1 .  Creator  dit tract  ion  elficiency  is  possible  under  these  circumstances.  for  pedagogical  reasons  we  will 
assume  that  the  driving  signal  consists  ot  discrete  sinusoids.  In  practice,  however,  the  periodic  chirp 
waveform  is  more  likelv  tv'  be  used. 

The  system  ol  Fig.  9  will  prodm  v  a  1-D  arriv  ol  light  spots  if  driven  with  tin*  correct  sum  ot  sinusoidal 
signals.  We  need,  however,  a  .’-D  einoding  ari.o  ol  li  .ht  spots.  The  answer  to  this  problem  is  to  use  a 
second  AO  cell  operating,  at  right  angle*  to  tin  tir.t.  The  basic  idea  is  illustrated  in  Tig.  10.  In  Fig. 

10(a)  we  show  a  horizontal ly  aligned  AO  veil  driven  hv  a  sum  ot  zoro-phasv  cosines  spaced  by  Af  in  frequent v. 
The  liglit  spv'ts  in  the  assoc  iatevi  dittra.  t  ion  pattern,  in  the  back  local  plane  of  the  ions,  are  separated  in 
optical  frequency  bv  *.!  .  Figure  lt)(b>  shows  an  ort  liogona  I  1  v  v'riented  cell  driven  at  frequencies  that  are 
integer  multiples  of  NM,  where  NxN  is  the  sice  ol  the  array  tv'  lie  encoded.  As  indicated,  adjacent  dit  frac¬ 
tion  spots  I rom  this  cell  are  separated  in  i re<;uenev  bv  N'f.  It  these  t wo  orthogonal  cells  are  placed  in 
close  contact  (or,  in  practice,  imaged  onto  one  another),  their  spatial  t ransm ' • t ance  I  unctions  multiply, 
with  a  resultant  convolution  ot  the  assov  iatevi  <i  i  t  l  ra-  t  ion  patterns,  as  shown  in  lig.  10(c).  It  is  easily 
shown,  bv  considering  how  the  frequency  sh  i  i  t  s  avid  <*n  a  spot-bv-spot  basis,  that  the  encoding  spots  in  the 
rt*sulting  d-D  arrav  are  separatevl  bv  't  in  one  direct  ion  and  bv  N't  in  tin*  other.  This  is,  of  course, 
precisely  what  is  desired  lor  an  NxN  encoding  arrav.  In  practice,  an  NxN  arrav  ol  frequency-shifted  spots  is 
selected  to  mix  with  a  non-f requen*  v  shitted  plane  wave.  The  resultant  arrav  ot  intensity-modulated  light 
snots  then  t  rails  i  1  I  umi  nates  tin*  SI.M,  as  des,  r  i  bed  earlier. 

With  some  Mod i t i cat  ion ,  the  basic  scheme  described  above  can  be  used  tv*  encode  comp] ex-valued  spatial 
distributions  |2,7|.  For  example,  let  g(x,v;t)  he  the  complex  wave  amplitude  distribution  in  the  Fourier 
transform  plane  of  n  coherent  <»ptical  processor .  JJ  this  d i s t r i hu t i on  is  mixed  at  a  large  area  detector  with 
the  array  of  frequenev-shi f ted  encoding  spots,  the  detector  output  signal  will  contain  the  desired  signal 
gj-(t)  given  in  F.q .  O) .  Should  g(x,v;t)  he  the  complex  amplitude  transmittance  of  a  S1.M,  it  can  be  encoded  by 
transi  lluminat  ing  the  SI>1  with  the  frequency  shitted  encoding  array  pr_i_or  to  mixing  with  the  non-f requenev 
shifted  reference  wave. 

Several  notes  are  in  order.  First  ol  all,  the  Unite  length  ol  tin*  AO  cell  aperture  will  produce  a 
spreading,  or  smearing,  of  the  individual  light  spots.  To  tin*  extent  that  the  frequency  shifted  beams  overlap 
spatially,  their  interference  will  produce  light  intensity  fluctuations  tim'uj^liout  tin*  entire  encoding  region 
at  low  integer  multiples  of  At  and  NA1‘.  Since  these  I  1  actual  inns  are  not  specific  to  any  one  sample  location, 
it  is  necessary  to  work  with  an  arrav  ol  light  spots  well  removed  from  the  optical  axis  of  the  transform  lens. 
Under  these  circumstances  the  offset  frequency  I ^  in  lq .  (1)  is  sufficiently  high  that  the  desired  frequency- 

division  multiplex  components  of  the  defector  output  are  separated  in  frequency  1 rom  the  nonspecific  lower 
frequency  terms. 

A  second  point  relates  to  the  aspect  rati.*  ot  tvpival  AO  devices.  For  i easons  of  power  consumpt ion  and 
dif 'ruction  et  I  i  *  ieiicv,  the  opto-acousl  ic  iutot  action  region  tor  most  At)  cells  is  long  and  narrow.  As  a 
consequence ,  ananmr  pit  i  c  lens  systems  ot  large  d  i  I  f  »■  ren  t  i  a  l  magnification  are  required  it  one  cell  is  to  be 
Imaged  entirely  onto  another  tor  generation  ol  the  .’-I)  encoding  arrav. 

The  third  point  relates  to  the  bandwidth  required  ol  the  AO  devices.  In  order  to  operate  as  suggested  in 
Fig.  10,  it  is  necessary  that  one  veil  operate  in  a  I  requeue v  band  N  times  higher  than  the  other.  If  N  is 
large,  this  necessitates  the  use  o!  two  subs t an t  i  a  I  1  v  diflerenl  devices,  one  operating,  for  example,  in  the 
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fcns  of  megahertz  range,  the  other  operating  in  the  gigahertz  range.  An  attractive  alternative  is  suggested 
in  i'ig.  11.  If  two  veils,  one  driven  at  integer  multiples  of  NAf  and  the  other  at  integer  multiples  ot 
(N-l).M,  are  oriented  approx  imate  I  v  *  *S  °  to  each  other  and  plaeed  in  o[»tieal  cont.iet,  the  resultant  ditfraetion 
pattern  has  the  appea ranee  shown  at  tin*  right  of  Kig.  11.  As  shown,  the  separation  in  optical  frequency  ol 
adjacent  spots  is  M*  in  one  direction  and  NAt  in  the*  other,  as  desired  for  tin*  encoding.  The  important 
i  ‘laraeterist  i  e  t>f  this  seheiiK*  is,  ot  course,  that  the  two  evils  operate*  in  essentially  the  same  frequence 
range.  There  is,  however,  some  sacrifice  in  the  size  of  the  arrav  that  can  he  encoded. 

Kinallv,  we  note  that  the  dynamic*  range  of  the  signal  wavelorm  g((t)  may  he  quite  large  if  all  the  carriers 
ot  I'q.  (  1)  are  modulated  with  the  same  phase*.  This  is  of  necessity  the  case  when  nonnegat  ive-rea  1  (intensity) 
distributions  are  to  be  '"coded  for  processing  purposes.  If  simple  image  transmission  (see  Kef,  2)  is  the 
goal,  tin*  ‘  can  be  randomized  to  reduce*  the  range*  ot  gj-(t).  II  hi  po  lar-ri-a  I  processing  is  the  goal,  it  is 
possible  to  pi*  r  form  oper.it  ions  analogous  to  bipolar  noue*ohc*rent  spatial  filtering  (K|  with  reduced  dynamic 
range.  A  description  « *  t  these*  operations  is  beyond  the  scope*  ot  this  paper. 

Acoustooptic  Output  ("emersion  (liisnlav) 

figure*  ! 2  illustrate*s  a  svsi»*m  suitable*  tor  the  conversion  •»!  the  proeessor  outmit  signal  w.ivi'l  c'rm  i,(t) 
into  t!u*  corresponding  2-P  display  if\,v;t).  This  display  system  is  based  on  i  2-1)  time  integration  spedrum 
analysis  sche-mo  described  by  Turpin  and  by  Kell  man  |2,1}.  A  modi  tied  spectrum  analysis  scheme*  proposed  by 
•lader  is  also  applicable  (h).  In  the  system  e>f  Kig.  12,  an  NxN  arrav  ol  appropriately  f  requenev-sh  i  f  te*d  spelts 
(;  rod  ved  In  a  pa  i  r  of  AO  cells,  as  described  earlier)  mixe*s  in  tin*  output  plane  with  a  mutually  coherent 
'lain*  wave*  that  is  moelul  ate*el  in  time*  by  the  signal  f^-(t).  (The*  modulation,  on  a  wave*  amplitude  basis,  can  be 
acomp  1  i  shed  using  aruHhcr  acoustoopt ic  cell  drive*n  by  signal  wavelorm  f(t).)  At  the  mth  sample  location  in 
;  In*  output  plane,  the  display  intensity  is  tints  given  by 


(x  , v  ; t )  = 


(8) 


win*  re  exp  |  i  .  t  1  is  tin*  nhasor  r»*pre**;e*n  tali  e»n  ol  t  he*  mth  t  rcqucnev-sh  i  t  t  cc!  light  spot.  II  we  substitute*  for 
i(U)  (using  Kq,  (3>  with  f  tor  the  magnitude  and  0  for  the  phase)  and  collect  terms,  we  obtain 
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!ii<  tirst  and  second  terms  correspond  to  a  uniform  bias  across  the  entire  display.  The  third  term  evaluates 
t-  f<x^,vm;t)  ce»s0txm,vm;t  >  *  Re  f  (x^,  vn  ;  t  )  1  ,  with  t  he*  result 
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a  low  contrast  version  ot  tin*  real  part  o!  tin-output  distribution.  If  f(x,v;t)  is  real  valued,  this  is  all 
that  is  sought.  for  c*omp  lex-va  I  iu*d  f(x,y;t),  tin*  imaginary  part  is  obtained  bv  shifting  tlu*  optical  p!  aso  of 
one  ot  the  d i s t r i hut i ons  bv  /2  radians. 


I  nip  I  i  <  .1 1  i  ons  lor  Highspeed  Imaj^e*  Process  i  ng 

Jin*  overall  system  ol  Kir.,  ’‘--encoders,  processor,  dce*cule*r — a  re*  .ill  capable*  ol  ope*rat  ion  at  high  speed  for 
a  variety  ot  realtime  image  processing  app  l  ieat  ions .  Multiplier  and  filte*ring  e*  1  eet  run  i  cs  for  the*  processor 
with  gigahertz  bandwidths  are  well  within  st  at  e-e»f- 1  he-ar  t  capability.  Tin*  at*  oust  oe>pt  ic*  devices  used  I  or 
emocle*r  and  decoder  can  provide  1-1)  sp.icehandwi elth  products  up  to  10(10  or  more*,  tor  a  total  image*  size 
approaching  lOOOxiOOO.  Operational  bandwidths  for  wideband  AO  de*viee*s  now  exe*e*e*d  cue*  gigahertz.  It  thus 
appears  that  gi  gahert  ra  te  processing  of  1000x1000  element  imagery  should  be  achievable  with  state-of-the-art 
technology,  cor  respond  i  ng  to  roughly  1000  2-1)  cor  re*  la  t  i  ons  per  second.  The*  actual  rate  at  which  g(x,v)  and 
h(x,v)  can  change*  will  be  limited  in  many  cases  bv  the*  SI.Ms  employed.  In  one  important  area  e>f  application, 
target  acquisition  and  tracking,  the  input  image  may  change*  relatively  slowly,  while  the  spatial  impulse 
response  h(x,v;t;  is  varied  rapidly  in  a  pattern  recognition  seareh  operation.  I’nder  these  c  ircumstances , 
h.(t)  need  not  e*xist  in  2-D  spatial  torm.  Rather,  it  can  be*  steered  in  1-1)  serial  le>rm  and  input  at  high  speed 
directly  into  the*  multiplier. 

We  indr  in  rone  1  us  i  on  that  an  experimental  program  has  been  begun  to  demonstrate*  the*  concepts  discussed 
above  u.ing  AO  techno logv.  This  work  is  being  supported  bv  a  grant  from  the  K.S.  Air  Korce  Office  ol 
S.  ictitilie*  Kese*.i re h .  I'unding  for  much  ot  the*  conceptual  development  came*  from  the*  L’.S.  Army  Research  Office. 
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fjc.  i.  Qrticci-electronic  svster  encodes 
time-very  inc  i-p  input  distribution,  c(x,y;t>, 
os  collection  cf  moaulatec  temporal  frecuencv 
corriers. 


Fig.  1,  Hybrid  optical-electronic  imaoe 
processing  svster  performs  sDatial  convolution 
or  correlation  of  two  input  distributions,  eacn 
potentially  time  varying. 


0 

Fin.  s.  N‘  temporal  freauenries  correspond  to  o 
left-to-riaht,  top-to-bottor-  order  mo  of  associated 
NxN  arroy  of  snatlol  sonnies  of  imaoe. 


Fin.  g,  Fxample:  SxF>  Imaoe  (Intensity'  sample  orrav  and  spectrum 
of  associated  i-P  fteauenrv  division  multiplexed  si ona I  represen¬ 
tation.  spectral  components  me  moaned  uc. online  to  row  mrt'oi 
In  imaoe . 


Fig,  5.  System  diagram  far  realtime  convolver/correlator. 

SfT  denotes  bandpass  filter,  Ilf  I  CONV  denotes  heterodyne  converter. 
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Fin,  6,  Example  o‘  2-D  convolution  with  freauencv  coded 
sianals.  'Inputs  assumed  to  be  nonneaat ive-real  and  with 
inteaer  sample  values.  Only  positive  freauency  cr  ponents 
are  shown. 


Fic,  7.  Spectrum  of  system  output  (o),  ond  associated 
decoded  spatial  distribution  (D)  resulting  from  convoi 
ution  of  two  arrays  in  Fic,  6. 


mth  cell 


INTENSITY  TRANSMirrANC-F 
K( *.v;t) 


Fla,  8.  Encodlna  slnnle  Imooe  sample  with  sinusoidally 
modulated  1 laht  beam. 


Flo.  9.  Interferometer-bosed  system  with  acoustooptic  cell 
for  FDM  encodlna  soatlal  samples  of  Input  Imoqe.  SIM  Is 
placed  In  encodlna  aperture.  In  front  of  lorae  area  detector, 
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Fla.  10.  Use  of  acoustooDtlc  cells  In  oeneratino  array  of 
freauency-shlfted  encodinq  light  soots. 
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Fig.  11. 
ooerat' 


1.  Encod Inn  array  can  be  obtained  with  two  acoustooptic  cells 
Ing  In  same  frequency  ronne  If  they  are  crossed  at  45°, 


M 


Fla,  1?,  Time  Integration  spectrum  onolyzer  for 
output  convers lon/d  Iso  lav  or  processed  imooe. 
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Contrast  in  time-integration  optical  processing 

William  T.  Rhodes 

Georgia  Institute  of  Technology.  School  of  Electrical  Engineering,  Atlanta,  Georgia  30332 


Abstract 

The  problem  of  bias  buildup  in  t ime-int egrat ion  image  processing  is  assessed*  Numerical  studies  are 
presented  that  compare  the  results  of  the  usual  approach  to  interferometric  time-integration  processing  with 
a  proposed  minimum-bias  approach-  It  is  concluded  that  the  latter  approach  yields  outputs  of  dynamic  range 
adequate  for  many  practical  image  processing  situations- 

In  t  rodu  c  t ion 

Time-integration  optical  processing  methods  have  been  used  for  1-D  signal  correlation,  l-D  spectrum  analysis, 
and  ambiguity  function  processing  [1-121-  Although  many  processing  operations  described  in  the  literature 
are  1-D  in  nature,  2-b  systems  have  been  described  for  large  time-bandwidth  product  spectral  analysis  of  l^D 
signals  [4-6.8-11J*  Our  own  interest  lies  in  the  application  of  time-integration  methods  to  the  processing 
of  2-D  imagery.  The  reason,  without  going  into  detail  [13-16],  is  that  we  have  available  to  us  a  signal 
waveform  v^(t),  that  represents  as  a  function  of  time  a  scanned  version  of  spatial  frequency  transform 
F(u,v).  In  order  to  obtain  the  corresponding  output  image,  f(x,y),  it  is  necessary  to  inverse  Fourier 
transform  F(u,v).  This  can  be  done  spatially  if  F(u,v)  is  recorded  as  a  hologram  and  Fourier  transformed 
with  a  lens-  It  is  more  direct,  however,  if  the  spatial  frequency  components  of  f(x,y)  are  added  up 
sequentially  in  time  -  i-e.,  via  time  integration- 


Fig.  1.  Two  coherent  light  spots  producing  fringe  pattern 

The  basic  idea  is  illustrated  in  Fig.  1-  In  the  input  plane  are  two  mutually  coherent  light  spots,  one  or 
both  of  which  can  be  moved  about  and  varied  in  magnitude  and  relative  phase*  The  corresponding  Intensity 
distribution  in  the  output  plane  Is  a  sinusoidal  fringe  pattern  whose  spatial  frequency  is  governed  by  the 
vector  separation  of  the  two  light  spots  and  whose  contrast,  magnitude,  and  phase  are  governed  by  the 
magnitudes  and  relative  phase  of  the  light  spots-  The  essence  of  the  time-integration  image  synthesis 
procedure  is  to  build  up  a  composite  image  distribution,  fringe  pattern  by  fringe  pattern*  This  is  basically 
a  Fourier  synthesis  operation,  each  sinusoidal  intensity  fringe  pattern  corresponding  to  a  Fourier  component 
of  the  image  distribution-  A  system  that  could  be  used  in  producing  such  a  fringe  pattern  is  illustrated  in 
Fig-  2*  The  two  light  spots  producing  the  fringe  pattern  are  moved  about  for  different  vector  spacings  via 
two  orthogonally  driven  galvanometer-mounted  mirrors-  Magnitude  and  phase  of  the  two  light  spots  are  varied 
by  the  modulators* 

A  major  problem  with  such  an  image  synthesis  operation  is  immediately  evident:  as  every  fringe  pattern, 
or  Fourier  component,  carries  with  it  some  bias,  the  superposition  of  a  large  number  of  components  will 
generally  result  in  a  low  constrast  inage.  Should  the  signal-to-bias  ratio  be  sufficiently  low,  available 
detectors  (either  film  or  electronic)  will  he  Incapable  of  recording  the  image  with  good  signal-to-noise 
ratio* 

In  what  follows,  we  consider  two  approaches  to  producing  these  fringe  patterns  and  calculate  numerically 
the  results  for  typical  imagery.  We  are  then  In  a  position  to  draw  conclusions  regarding  the  viability  of 
time-integration  schemes  in  image  processing. 

Cons  t a n t  Ref  e fence  Synthes  is 
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Fig.  2.  System  for  producing  sequence  of  fringe  patterns. 


Our  objective  with  the  system  of  Fig.  2  is  to  produce,  sequentially  in  time,  a  sequence  of  sinusoidal 
intensity  fringe  patterns  corresponding  to  real  Fourier  components  of  the  form  | F(u , v) |cos f 2n (ux+vy )  + 
arg(F(u,v) )] .  A  straight-forward  method  of  doing  so  is  to  keep  the  amplitude  of  one  wave  in  the  output  plane 
of  Fig-  2  equal  to  a  constant,  Rq,  and  to  allow  the  complex  amplitude  of  the  interfering  wave  to  vary  as 
F(u,v).  Under  these  circumstances,  the  elementary  fringe  pattern,  If(x,y;u,v),  has  the  form 


!f(x,y;u,v)  *  |Rq  +  F(u,v)e 


j  2*  (ux+vy  )  .  2 


R2  +  |F(u  v)|2  +  2Re{  P  F(u  .  v)ej2’' <“X+"vT>) 


(l) 


where  Re<  }  denotes  the  real  part.  As  tine  progresses,  u  and  v  are  scanned  i.e.,  fringe  patterns  of 
different  spatial  frequencies  (u,v)  are  produced-  Assuming  that  u  and  v  are  scanned  through  the  entire  range 
for  which  F(u.v)  is  nonzero,  the  superposition  of  all  such  fringe  patterns  yields  the  integrated  fringe 
pattern  given  below: 

I (x,y)  *// R^dudv  +  //  |  F(u,v)  |  ^dudv 

+  2RoRe{//F(u,v)ej2”  VUX+Vy)dudv>,  (2) 

The  term  in  curly  brackets  is  recognized  to  be  the  inverse  Fourier  transform  of  F(u,v),  or  f(x,y).  Assuring 
this  latter  function  is  real  -  the  case  of  Interest  here  -  the  integrated  fringe  pattern  is  given  by 

I(x,y)  -  BIAS  +  2R  f(x,y).  (3) 


Each  fringe  pattern  entering  into  the  synthesis  of  Fq.  (2)  has  a  contrast  or  visibility  given  by 

V(u,v;R  )  -  R  | F (u  v) |/(R2+|F(n,v) |2).  (4) 

o  o  o 

In  order  to  maximize  the  contrast  of  the  integrated  fringe  pattern,  we  choose  the  reference  wave  amplitude  R 
so  as  to  maximize  the  average  fringe  visibility: 

Ro  -  E{  |  F  (u ,  v )  |  } ,  (5) 

where  E<  >  denotes  an  average  over  all  components  actually  entering  into  the  synthesis.  (because  of  the 
excessive  bias,  zero  spatial  frequency  is  omitted  In  the  synthesis.)  In  order  to  gain  some  feel  for  the 
signal-to-bias  ratio  resulting  from  such  a  synthesis,  we  simulated  the  operation  on  a  computer.  The 
256x256-pixe 1  images  shown  in  Fig.  3  served  as  Input.  In  all  three  eases  the  input  image  Intensity  range  was 
adjusted  to  have  a  minimum  value  of  0-0  and  a  maximum  value  of  1-0-  Application  of  the  constant  reference 
synthesis  algorithm  to  image  (a)  resulted  in  an  output  image  with  bias  level  equaling  147-0  and  image  signal 
fluctuations  in  the  range  147. 0  to  14F.0.  The  visual  contrast  of  such  an  image  is  so  low  that  no  image 
structure  could  be  perceived.  However,  detectors  of  sufficient  dynamic  range  are  capable  of  measuring 
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Fig.  3.  Test  images  used  as  inputs  to  numerical  simulations. 

extremely  low  contrast  imagery*  lor  example,  charge  coupled  photo-diode  arrays  with  dynamic  ranges  of 
approximately  12  bits,  corresponding  to  \  peak  intensity  of  4095  relative  to  unity  rms  noise  f luctuat ions, 
are  available*  If  such  a  detector  were  used  to  detect  the  low  contrast,  constant-reference  synthesis 
corresponding  to  image  (a),  a  post-detection  bias  subtraction  would  yield  an  image  with  27  to  28  meaningful 
(in  a  sipna l-to-noise  ratio  sense)  levels  of  display  intensity.  Stated  differently,  if  the  peak  intensity  of 
the  low-contrast  image  is  set  equal  to  the  maximum  detectable  relative  intensity  value,  4095,  all  image 
fluctuations  occur  in  the  top  28  levels  of  the  detector  range*  The  final  output  image  thus  has  a  dynamic 
range  (peak  intensity  variation  to  res  noise  fluctuation)  of  28-1,  or  about  4*8  bits.  Results  for  image  (a), 
along  with  those  for  Images  (bj  and  (c ) ,  ar*»  surra ri zed  in  Table  1* 


TABLE  1 

RESULTS  -  CONSTANT  REFERENCE  SYNTHESIS: 

12  BITS  OF  DETECTOR  DYNAMIC  RANGE 

IMAGE  A:  27  to  28  levels  of 
di splay  -  9.8  bits 

IMAGE  B:  48  to  49  levels  of 
display  -  5.b  bits 

IMAGE  C:  49  levels  of  display 
5.6  bits 


Unity  Contrast  Fringe  Synthesis 

If  a  synthesized  image  of  contrast  higher  than  that  achievable  with  the  optimum  constant  reference  synthesis 
is  to  be  obtained  it  is  necessarv  for  both  interfering  wa>vs  to  vary  in  amplitude.  Highest  possible  image 
contrast  (and,  therefore,  highest  output  s ipna I -t o-noi sc*  ratio)  is  achieved  if  each  elemental  fringe  pattern 
has  unity  visibility  or  contrast.  This  condition  is  achieved  if  the  interfering  waves  have  the  same 
magnitude,  equal  to  the  square  root  *>t  |F(u,v)|.  Such  a  synthesis  is  represented  by  Fq  (6),  where  the  phase 
of  the  resultant  fringe  pattern  is  split  between  the  interfering  wave  amplitudes: 

I  j  ( x  ,  y  .  u ,  v  =  |F*''S(u.v)  +  r\„  vK.|o<«iK+.-yV 

«  |F(u.v)|<l  +  cos  (2tt(ux+-*v)  +  arp{  F  (u,  v)  }  ]  .  (6) 


Integrating  over  spatial  frequency  space,  v/r  obtain  the  integrated  fringe  pattern 

l(x.y)  *  Jj  |  F(u ,  v)  |dudv  +  Jj  }F(u  v)  |cos  {2*  (ux+vy  )  +  arg{F(ti  v))]dudv,  (7) 


which  again  has  the  form  I(x,y)  =  BIAS  +  f (x  v)  for  real  f(x,y).  When  this  kind  of  synthesis  is  simulated 
numerically  (again  excluding  u*v=P  from  the  integration),  images  of  considerably  higher  contrast  result*  In 
particular.  such  a  synthesis  applied  to  image  (a)  results  in  a  biased  image  with  minimum  value  11*2  and  peak 
value  12*2*  If  we  assume  a  4095:1  detector  intensity  dynamic  range,  3760/4095  of  the  dynamic  range  is  used 
tip  by  bias,  the  remaining  335  detect ible  levels  being  available  for  image  display*  The  dynamic  range  of  the 
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final  displayed  image  intensity  distribution  would  thus  be  335:1-  Table  2  summarizes  the  results  of  such  a 
synthesis  for  all  three  test  images. 


TABLE  2 

RESULTS  -  UNITY  CONTRAST  FRINGE  SYNTHESIS 

12  BITS  OF 

DETECTOR  DYNAMIC  RANGE 

IMAGE  A: 

335  levels  of  display 

8.4  bits 

IMAGE  B: 

582  levels  of  display 

9.2  bits 

IMACE  C: 

666  levels  of  display 

9.4  bits 

Effect  of  Increasing  lnnj?e  Space  ba ndwid th  Product 

It  is  well  known  from  the  study  of  incoherent  holography  that  the  signa  l-to-bias  ratio  of  syntheses  of  this 
type  decreases  with  an  increase  in  the  spacebandwidth  product  of  the  synthesis-  It  can  be  shown  that,  for 
fixed  signal  level,  the  bias  for  the  unity  fringe  contrast  synthesis  increases  in  proportion  to 
SBxE{ |F(u,v) (),  where  SB  denotes  the  spacebandwidth  product  of  the  synthesized  image-  For  the  constant 
reference  case,  bias  increases  in  proportion  to  SBx  (F.w{ | F | }  +  K{ | F | > ) /E{ | F | > .  Recalling  that  our  test 
triages  consisted  of  256x256  pixels,  we  would  expect  roughly  a  4:1  reduction  in  the  dynamic  range  of  more 
detailed  5 1 2x 51 2-p ixel  images-  Since  such  images  have  roughly  the  spacebandwi dth  product  of  TV  images 
(actually,  the  spacebandwidth  product  of  typical  television  images  is  perhaps  only  75%  of  that  of  a  512x512 
test  image),  these  numbers  are  particularly  significant.  Dividing  the  dynamic  ranges  shown  in  Table  2  by  a 
factor  of  four,  we  obtain  the  numbers  presented  in  Table  3. 


TABLE 

3 

512x512 

IMAGERY 

WITH 

12- BIT  DETECTOR 

TYl’E  A 

IMAGE: 

89 

levels 

or  6.5  bits 

TYPE  B 

IMAGE: 

146 

levels 

or  7.2  bits 

TYPE  C 

IMAGE: 

167 

levels 

or  7.4  bits 

Cone  1  us i ons 

The  numbers  in  Table  3,  representing  unity  contrast  fringe  syntheses  of  512x512  spacebandwidth-product 
Imagery  (assuring  a  detector  with  12  bits  of  dynamic  range  for  measuring  image  intensity  values),  can  only  be 
taken  as  rough  indicators  of  what  might  be  achieved  with  a  given  image.  Nevertheless,  these  results  are 
quite  encouraging.  Six  to  eight  hits  of  gray  level  is  generally  considered  adequate  for  high-quality  image 
display,  and  our  test  results  fall  within  that  range  for  imagery  of  spacebandwidth  product  exceeding  that  of 
conventional  television  imagery-  These  results  thus  clearly  indicate  the  acceptability  of  time-integration 
techniques  for  many  imago  processing  applications,  so  long  as  unity  contrast  fringe  syntheses  are  employed- 
Note  that  (from  Table  2)  a  constant  reference  synthesis  would  result  in  a  512x512  spacebandwidth  product 
image  display  with  dynamic  range  between  three  and  four  bits  of  pray  level-  Such  displays  would  typically 
appear  noisy  to  the  observer- 

It  should  be  noted  that  imagery  that  has  undergone  significant  processing,  for  example  highpass  or 
bandpass  filtering.  naw  exhibit  signi f J rant Iv  different  statistics  and  result  in  imagery  of  display  dynamic 
range  t'  at  is  substantially  higher  or  lower  than  was  the  case  for  the  three  test  images-  We  also  point  out 
that  the  bias  reduction  philosophy  described  in  this  paper  is  applicable  not  only  to  tine  integration  image 
processing,  but  also  to  time  Integration  spectral  analysis  and  to  time-integration  holography  (17, IS]. 
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Abstract- The  use  of  acousto-optic  devices  in  real-time  signal  convo¬ 
lution  and  correlation  has  increased  dramatically  during  the  past 
decade  because  of  improvements  in  device  characteristics  and  imple¬ 
mentation  techniques.  Depending  on  the  application,  processing  can  be 
implemented  via  spatial  or  temporal  integration.  Two-dimensional 
signal  processing  (including  image  processing)  is  possible,  in  spite  of  the 
inherent  one-dimensionil  nature  of  the  acousto-optic  device  as  a  spatial 
light  modulator. 

I.  Introduction 

HE  ACOUSTO-OPTIC  cell  has  a  long  history  of  applica¬ 
tion  to  optical  processing  and  display,  dating  back  at 
least  to  the  late  1930’s  when  Okolicsanyi  proposed  its 
use  in  projection  television  systems  [  1  ] .  References  to  its  use 
in  converting  electrical  signals  into  spatial  light  distributions 
appear  in  a  number  of  early  papers  on  optical  signal  processing 
[21—14) ,  and  in  the  1960’s  extended  research  programs  were 
conducted  on  its  application  to  the  processing  of  radar  and 
telecommunications  signals  [5]-[16].  Various  techniques  de¬ 
veloped  during  this  period  have  been  described  by  Maloney  in 
a  highly  readable  paper  in  IEEE  Spectrum  magazine  (171.  De¬ 
velopments  of  new  techniques  since  1970  have  significantly 
enhanced  the  capabilities  of  acousto-optic  cells  in  specific 
signal  processing  tasks.  For  example,  through  the  application 
of  time-integration  acousto-optic  processing  methods,  process¬ 
ing  time-bandwidth  products  greatly  exceeding  the  time- 
bandwidth  product  of  the  acousto-optic  device  itself  can  be 
achieved,  and  spatial  filtering  of  two-dimensional  (2-D)  distri- 
butions-e.g.,  image  deblurring-is  possible. 

This  paper  presents  a  tutorial  review  of  acousto-optic  signal 
processing  methods,  particularly  those  developed  during  the 
1970’s,  as  they  relate  to  the  linear  shift-invariant  filtering 
operations  of  convolution  and  correlation,  both  1-D  and  2-D. 
(See  [181  for  a  complementary  discussion  of  acousto-optic 
methods  in  signal  spectral  analysis.)  We  place  major  emphasis 
on  systems  aspects,  choosing  examples  to  illustrate  key  points. 
A  Fourier  optics  point  of  view  is  stressed  throughout 
[19}-[211. 

II.  Use  of  Acousto-Optic  Cells  as 
Spatial  Light  Modulators 
A.  General  Background 

If  the  operation  of  different  acousto-optic  correlators  and 
convolvers  is  to  be  understood,  it  is  important  that  the  basic 
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relationship  between  the  driving  electrical  signal  and  the  re¬ 
sultant  modulation  of  light  waves,  both  spatially  and  tem¬ 
porally,  be  clear.  In  order  to  facilitate  a  better  understanding 
of  the  systems  described  in  later  sections,  we  therefore  first 
review  the  basic  characteristics  of  acousto-optic  cells  as  spatial 
light  modulators.  We  begin  by  considering  briefly  certain 
physical  constraints  that  bear  on  the  types  of  signal  waveforms 
that  can  serve  as  input  and  the  ways  in  which  acousto-optic 
cells  can  be  used. 

To  begin  with,  acoustic  waves  launched  by  the  transducer 
into  the  cell  frequently  cannot  be  viewed,  or  otherwise  de¬ 
tected  optically,  if  they  are  imaged  in  conventional  fashion. 
Like  an  unstained  amoeba  under  a  microscope,  the  acoustic 
wave  structure  remains  unseen  unless  some  special  technique, 
such  as  phase  contrast  imaging  or  dark  central  field  imaging,  is 
used  to  render  it  visible  [  1 9,  ch.  7 ] . 

As  another  point  of  great  opoaiionai  importance,  w  :  note 
that  the  electrical  signals  that  nrivt  acousto-optic  cells  must 
generally  be  bandpass  in  tt&fre,  'vit.  ■'  u,.uency  content 
typically  in  the  range  c'  i  S-Alc  to  1  GIL..  Reasonably  large 
fractional  bandwidths  are  acceptable,  depending  on  the  natuie 
of  the  acousto-optic  material  and  the  transducer  [22].  This 
restriction  on  the  input  signal  waveform  means  that  signals  to 
be  processed,  if  not  originally  bandpass  in  nature,  must  be 
placed  on  earners  in  order  to  be  suitable  for  input.  The  carrier 
can  be  modulated  in  both  magnitude  and  phase,  allowing  com¬ 
plex  signal  processing.  In  many  cases,  an  acousto-optic  cell 
can  be  used  directly  in  processing  of  radar  and  RF  communica¬ 
tion  signals  without  the  need  for  additional  modulation. 

Finally,  it  should  be  recalled  that  physical  size  of  the  cell 
and  attenuation  of  sound  waves  in  the  cell  material  limit  the 
practical  duration  of  the  signal  contained  in  the  cell  at  one 
instant  in  time  to,  typically,  a  few  tens  of  microseconds.  This 
prevents  the  use  of  acousto-optic  devices  in  many  speech  and 
other  voiceband  signal  processing  operations,  where  the  mini¬ 
mum  useful  time  window  is  typically  tens  of  milliseconds 
(An  exception  occurs  in  spectrum  analysis,  where  time- 
integration  acousto-optic  processing  methods  can  yield  useful 
short-time  spectra  with  time  windows  in  the  tens-of- 
milliseconds  range.) 

B.  Analytical  Modeling 

When  used  as  a  spatial  light  modulator,  an  acousto-optic  cell 
is  illuminated  by  a  beam  of  light,  usually  collimated,  and  the 
wave  field  of  that  beam  is  modified  by  the  sound  .aves  in  the 
cell  via  diffraction  processes.  The  nature  of  the  acousto-optic 
interaction  is  influenced  by  the  thickness,  in  the  direction  of 
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light  wave  propagation,  of  the  interaction  region.  Specifically, 
if  this  thickness  is  large  compared  to  the  distance  between 
neighboring  acoustic  wavefronts  in  the  cell,  Bragg  or  volume 
effects  are  significant  and  conditions  for  diffraction  of  the 
incident  light  are  modified.  We  begin  by  modeling  “thin”  in¬ 
teraction  or  Raman-Nath  regime  operation,  then  consider 
modifications  necessary  for  Bragg  regime  modeling.  Our 
analysis  is  1-D  in  nature  except  where  extension  to  two  dimen¬ 
sions  is  necessary.  In  modeling  the  cell  we  assume  that  sound 
wave  reflection  at  the  end  of  the  cell  opposite  the  input  trans¬ 
ducer  is  suppressed,  i.e.,  acoustic  wave  propagation  is  uni¬ 
directional. 

With  reference  to  Fig.  1 ,  the  signal-driven  acousto-optic  cell 
is  characterized  by  a  complex  wave  amplitude  transmittance 
function  t(xrt),  where  x  is  the  spatial  coordinate  along  the 
axis  of  acoustic  wave  propagation  and  t  denotes  time.  (We 
consistently  use  boldface  notation  to  denote  complex-valued 
quantities.)  If  we  let  r(x)  represent,  to  within  a  proportional¬ 
ity  constant,  the  transducer-induced  elastic  strain  field  in  the 
acousto-optic  medium  at  time  t  =  0,  t(x,  t)  is  given  by  (17) 

fix,  t)  =  exp  l/s(x  -  Vt)\  rect  (x/W)  (1) 

where  F  is  the  velocity  of  the  strain  field  in  the  medium  (the 
acoustic  velocity),  W  is  the  width  of  the  cell,  and  rect(-)  de¬ 
notes  the  unit  rectangle  function.  The  origin  of  the  x-axis  is 
placed  at  the  middle  of  the  cell.  The  strain  field  at  the  trans¬ 
ducer  end  of  the  cell,  x(-( H'/2)  -  Vt],  is  proportional  to  the 
input  signal  voltage  v(r);  i.e., 

s[~(W/2)-  Ff)  =  mo(f)  (2) 

where  m  is  a  proportionality  constant.  If  (1)  is  rewritten  in 
terms  of  u(f),  the  resulting  representation  for  r(x,  t)  has  the 
advantage  of  linking  the  acousto-optic  cell  transmittance  and, 
thereby,  any  processor  outputs  directly  to  the  input  signal 
waveform.  However,  the  form  of  (1)  lends  itself  to  a  more 
compact  analysis  of  the  operation  of  processing  systems  con¬ 
sidered  initially  and  will,  therefore,  be  used  for  the  time  being; 
i.e.,  r(x  -  Vt)  will  itself  in  general  be  treated  as  the  system 
input,  with  (2)  providing  the  link  to  the  driving  electrical  signal 
waveform.  Pictorial  reasoning  is  generally  adequate  in  linking 
six  -  Vt)  and  u(t):  if  s(  •)  and  mv(-)  are  plotted  as  functions  of 
the  same  variable,  they  vary  only  by  a  horizontal  scale  factor 
(the  sound  velocity)  and  a  delay  (corresponding  to  the  time 
required  for  the  strain  wave  to  propagate  from  the  transducer 
to  the  optical  axis  at  x  =  0). 

As  suggested  earlier,  the  driving  signal  waveform  is  normally 
an  RF  carrier  that  is  modulated  in  magnitude  and  phase.  We 
write  the  corresponding  strain  wave,  for  t  =  0,  as 

six) -aix)  cos  (2ir/0x  +a(x)).  (3) 

Substituting  for  six  -  Ft)  in  (1)  and  expanding  the  exponen¬ 
tial  in  a  power  series,  we  obtain  (with  H.O.  denoting  higher 
order  in  s) 

rix,  t)  =  {l  +  /six  -  Vt)  +  H.O.}  rect  (x/W) 

=  {l  + /aix  -  Vt)  cos  (2ir/0(x  -  Vt) 

+  a(x  -  Ft))  +  H.O.}  rect  (x/W).  (4) 

If  the  modulation  amplitude  a(x )  can  be  assumed  small,  the 
higher  order  terms  can  be  neglected,1  and,  on  expanding  the 

1  To  the  extent  that  a(x)  it  not  tnull,  intermodulation  products  be¬ 
come  significant  and  can,  in  tome  caaet,  adversely  affect  device  perfor¬ 
mance.  For  an  analysis  see  1 23|. 
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cosine  into  exponentials,  we  obtain 

fix,  t )  =  {1  +/a(x  -  Fr)  exp  (ya(x  -  Fr)|  exp  l/2n/0(x  -  Fr)l 
+  /a(x-  Fr)exp  (-/a(x-  Vt)  J 
•  exp  [-/2rr/0(x  -  Ff)]}  rect  (x/W),  (5) 

or,  equivalently, 

f(x,  f)  =  {1  +/«(x  -  Ff)  exp  (/2tr/0x)  exp  [-jhtv0t\ 

+  /a*(x  -  Ff)  exp  [-/2rr/0x ]  exp  [/2frp0fl}  feet  (x/W) 

(6) 

where  v0  is  the  temporal  frequency  of  the  driving  RF  carrier, 
related  to  spatial  frequency  /0  by  t>a  =  /0  F,  and  where 
a(x)=  |a(x)|,a(x)  =  arg  (a(x)}. 

It  is  of  considerable  use  to  us  in  later  analyses  to  express  the 
transmittance  function  t(x,y)  in  terms  of  the  analytic  signal 
six)  associated  with  six),  defined  by2 

fix)  =a(x)  exp  l/2ir/0x).  (7) 

Then  r(x)  =  Re{s(x)},  and 

f(x,  f)  =  {1  +  /(±)s(x  -  Ff)  +;(£)? *(x  -  Ff)}  rect  (x/W).  (8) 

Equations  (6)-(8)  serve  as  the  principal  basis  for  our  subse¬ 
quent  analyses. 

If  the  acousto-optic  cell  is  illuminated  by  a  monochromatic, 
normally  incident,  unit-amplitude  plane  wave,  the  complex 
wave  amplitude  of  the  transmitted  wave  u(x,  t)  equals  r(x,  f). 
It  is  instructive  to  consider  the  special  case  where  o(x  -  Ff)  =  1 ; 
i.e.,  the  driving  waveform  is  an  unmodulated  carrier.  Under 
these  circumstances,  u(x,  f)  is  given  by  (from  (6)) 

u(x,  f)  =  {1  +  /  exp  l/2jr/0x )  exp  [-/2irv0fl 

+  /  exp  [-/27t/0x]  exp  (/2irp0f)}  rect  (x/W).  (9) 

Let  v  denote  the  optical  frequency  of  the  incident  wave 
(~5X  1014  Hz):  v  =  c/A,  c  =  speed  of  light,  A  =  wavelength. 
If  we  ignore  the  effects  of  the  window  function,  the  three 
terms  of  (9)  represent,  respectively,  an  undiffracted  compo¬ 
nent  at  optical  frequency  v  traveling  in  the  +z  direction  (the 
zeroth  order);  a  diffracted  plane  wave  component  at  optical 
frequency  if  -  v0  )  with  propagation  direction  inclined  through 
angle  sin'1  (\/0)  toward  the  +x-axis  (the  -1  order,  taking  the 
sign  in  accord  with  the  frequency  shift)  and  a  diffracted  plane 
wave  component  at  optical  frequency  (•'♦I'®)  wit*1  propaga¬ 
tion  direction  inclined  through  angle  sin'1  (X/0)  away  from 
the  +x-axis  (the  +1  order).  The  directions  of  propagation  and 
respective  optical  frequencies  are  noted  in  Fig.  1.  The  shift  in 
frequency  of  the  diffracted  waves  can  be  viewed  in  terms  of 
conservation  of  photon  and  phonon  momentum,  Doppler 
shift,  or  as  a  natural  consequence  of  the  diffraction  process. 
All  points  of  view  lead  to  the  same  result.  The  Doppler  shift 
point  of  view  is  attractive  in  that  it  gives  us  on  inspection  the 
sign  of  the  frequency  shift. 

The  trio  of  diffraction  orders  in  (9)  (and  the  neglected  higher 
order  components  as  well)  is  characteristic  of  Raman-Nath 
regime  operation  of  an  acousto-optic  cell.  As  Bragg  regime 
operation  is  approached,  either  through  an  increase  in  acoustic 
frequency  v0  or  through  a  broadening  of  the  acoustic  beam, 

1  Strictly  speaking,  H*)  l»  not  tn  analytic  signal  as  defined,  but  rather 
the  exponential  repreientation  signal  associated  with  s(x).  However, 
the  difference  between  the  two  it  ignorable  for  the  narrow-band  cate  of 
concern.  See  (24). 
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Fig.  1.  Acoustooptic  cell  shotting  directions  and  center  frequencies  of 
diffracted  waves. 


Fig.  2.  Geometry  for  diffraction  in  Bragg  regime. 


the  diffraction  efficiency  for  normally  incident  illumination 
diminishes,  ultimately  to  an  insignificant  level.  To  observe 
diffraction  again,  it  is  necessary  to  rotate  the  cell  slightly  in  its 
plane,  as  shown  in  Fig.  2,  until  the  angle  the  incident  beam 
makes  with  the  cell  satisfies  the  Bragg  condition: 

6B  =  sin'1  (X/2A)  (10) 

where  A  is  the  acoustic  wavelength.  In  this  regime,  only  one 
of  the  first  order  diffraction  components  is  produced  with 
significant  magnitude.  For  the  case  illustrated  in  Fig.  2,  this  is 
the  downshifted  or  -1  component  at  frequency  (v  -  v0),  and 
the  effective  transmittance  of  the  cell  can  be  represented  by3 

r(x,  t )  =  {1  +  /«(x  -  Ki)  exp  [jilt  f^x  I 
•  exp  [-/2irp0fl}  rect  ( x/W ) 

=  {1  +/(£)*(*  -  Vt)}  rect  (x/W).  (11) 

If  the  cell  is  rotated  through  0B  in  the  opposite  direction,  it  is 
the  upshifted  or  +1  diffraction  component  that  is  produced, 

*  Amort  accurst*  model  would  include  a  complex  constant  of  propor¬ 
tionality  with  the  second  term. 


and  f(x,  r)  can  be  represented  by 

t(x,  t)  =  {1  +/«*(*  -  Vt)  exp  |-/2tr/0x] 

•  exp  [j1iti>0t]}  rect  (Jc/Hf) 

=  {l+/(±)i*(x-  Kf)}  rect  (x/W).  (12) 

As  noted  by  Korpel  1251,  relatively  large  fractional  band- 
wid.hs  for  the  complex  modulation  a(x  -  Vt)  can  be  accom¬ 
modated  while  good  Bragg  discrimination  against  other  orders 
is  retained  if  phased  array  transducers  are  used.  Bragg  regime 
operation  is  common  in  acousto-optic  processing,  particularly 
since  the  1 960’s,  because  of  the  greater  diffraction  efficiency 
that  is  generally  possible.  In  particular,  the  modulation  level 
a(x  -  Vt)  can  be  increased  significantly  without  the  production 
of  complicating  higher  order  diffraction  components. 

C.  Phase  to  A  mplitude  Conversion 

Essential  for  the  operation  of  most  acousto-optic  processing 
systems  is  the  conversion  at  one  stage  or  another  in  the  system 
of  the  temporal  and  spatial  phase  modulation  of  light, 
represented  by  (1),  into  some  form  of  temporal  and  spatial 
modulation  of  light  wave  intensity.  This  can  be  accomplished 
in  several  ways  using  the  spatial  filtering  system  of  Fig.  3.  The 
cell  is  illuminated  by  a  collimated  beam  of  light;  in  the  back 
focal  plane  of  lens  ,  appears  the  spatial  Fourier  transform  of 
r(x,f).  Successful  operation  of  the  spatial  filtering  system 
depends  on  the  physical  separation  in  the  spatial  filter  plane  of 
the  Fourier  transforms  of  the  three  terms  of  (7).  This  separa¬ 
tion  is  assured  by  the  bandpass  nature  of  six  -  Vt),  and  re¬ 
quires  only  that  the  spatial  bandwidth  of  the  modulation 
fl(x  -  Vt)  be  smaller  than  f0  (equivalently,  that  the  cutoff 
temporal  frequency  of  a(x  -  Vt)  be  smaller  than  i>0),  a  condi¬ 
tion  virtually  always  satisfied  in  acousto-optic  cell  operation. 

Two  principal  methods  of  conversion  are  described.  Addi¬ 
tional  methods  are  described  in  {26}.  In  the  Zernike  phase 
contrast  method,  the  optical  phase  of  the  undiffracted  wave 
from  the  cell  is  shifted  by  90  by  a  quarter-wave  plate  on  the 
optical  axis  in  the  spatial  filter  plane.  The  result  is  an  output 
plane  wave  amplitude  given  by  (from  (4)) 

u(x,  t)  =  {/'  +  js{x  -  Vt)}  rect  (x/W), 

with  corresponding  intensity,  given  by  1m(x,  Ol2 ,  equal  to 

/(x,  t)  =  {1  +  Isix  -  Vt)  +  s2(x  -  Fr)}  rect  (x/W).  (13) 

As  desired,  this  intensity  distribution  contains  the  signal  term 
j(x  -  Vt).  The  output  of  a  small  photodetector  at  point  x  in 
the  image  plane  will  be  proportional  to/(x,  t).  Only  six  -  Vt) 
itself  contains  temporal  frequency  content  about  the  carrier 
frequency  t»0 ;  thus,  if  the  detector  output  is  bandpass  filtered, 
an  output  electrical  waveform  proportional  to  a  delayed 
version  of  t»(r)  can  be  obtained. 

In  the  half-plane  stop  method,  either  the  +1  or  the  -1 
diffraction  order  is  blocked  in  the  spatial  filter  plane,  with 
the  resultant  output  intensity  (with  a  +1  order  stop) 

/(x,  t)  =  |l  +/($) six  -  Kr)|2  rect  ix/W) 

»{I+(i)«2(x-  Kf)  +  2r(0}  rect  ix/W).  (14) 

Again,  a  bandpass  filter  following  the  output  of  a  small  image 
plane  detector  yields  the  modulation  waveform,  since  the 
second  term  is  low-pass  in  nature.  If  the  acousto -optic  cell  is 
operating  in  the  Bragg  regime,  no  such  filtering  is  required,  the 
second  diffraction  component  being  naturally  suppressed. 
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Fig.  3.  Use  of  spatial  filtering  system  to  convert  phase  modulation  to  amplitude  modulation. 


It  is  important  to  note  that  neither  complete  temporal  nor 
complete  spatial  coherence  is  required  of  the  wave  illuminating 
the  acousto-optic  cell  in  order  for  these  conversion  processes 
to  operate,  and  indeed  this  is  true  of  most  of  the  correlators 
and  convolvers  to  be  discussed.  This  is  evident  if  we  consider 
the  effects  on  the  spatial  filter  plane  distributions  in  Fig.  3  of 
enlarging  the  source  of  broadening  its  spectral  bandwidth.  In 
either  case,  the  result  is  a  smearing  out  of  the  three  diffraction 
components  in  the  Fourier  plane.  However,  so  long  as  these 
distributions  do  not  overlap  spatially,  the  desired  filtering 
operation  can  still  be  performed.  (For  broad-band  sources.it 
is  necessary  to  use  achromatic  wave  plates  in  the  phase  shifting 
methods.) 

There  are  alternative  methods  for  modulation  conversion 
that  do  not  require  spatial  filtering.  For  example,  Meltz  and 
Maloney  note  that  simple  propagation  of  the  transmitted  opti¬ 
cal  wave  distribution  through  a  distance  Z.  =  XJ/2A  leads  to 
the  same  result  as  the  Zernike  phase  contrast  method  dis¬ 
cussed  above,  assuming  satisfactorily  small  modulation  band¬ 
width  1 14).  In  addition,  if  shear-wave  acousto-optic  cells  are 
employed  (for  example,  Te02 ),  lensless  conversion  methods 
using  birefringent  waveplates  and  polarizers  can  be  em¬ 
ployed  ( 16). 

III.  1-DSpace  Integrating  Convolvers 
and  Correlators 
A.  Notation  and  Basic  Relationships 

Given  two  real-valued  distributions  i,  (x)  and  j2(x),  we 
desire  to  evaluate  either  their  convolution  or  their  cross 
correlation.  Since  the  two  operations  are  related  through 
simple  coordinate  reversals,  we  concentrate  on  the  cross  corre¬ 
lation,  this  being  the  operation  of  greatest  interest  in  radar 
and  RF  communications  signal  processing.  In  acousto-optic 
processing,  s,  (x),  s3(x),  and,  therefore,  their  cross  correlation 
are  narrow-band  signals- carriers  modulated, in  general,  both  in 
magnitude  and  in  phase.  As  we  shall  see,  acousto-optic  correla¬ 
tors  can  be  constructed  to  yield  as  output  either  the  envelope 
of  the  correlation  function  or  the  entire  complex  modulated 
carrier. 

Before  considering  specific  examples  of  systems,  we  estab¬ 
lish  some  basic  notation  and  relationships  for  the  correlation 
integral.  The  cross  correlation  of  real  st  and  s3  is  given  by 


(infinite  limits  are  assumed  unless  otherwise  noted) 


R)2(t)  =  J s,(x)j2(x  +  r)  dx 

(15a) 

=  J\,(x  -  t)j2(x)  dx. 

(15b) 

Following  the  notation  established  in  Section  II,  we  write 

r,(x)  =  «,(x)  cos  12tr/0x  +  a,  (x)l 

(16a) 

=  Re  {*,  (x)} 

(16b) 

s2(x)  =  a2(x)  cos  l2ir/o*  +a2(x)l 

(Pa) 

=  Re  {i*2  (x )} 

(17b) 

where  i",  and  i2  are  the  analytic  signals  associated  with  r,  and 
j2,  respectively.  Exploiting  the  properties  of  the  analytic 
signal  representation,  one  can  write  the  correlation  of  real 
waveforms  s,  (t)  and  s2(r)  in  terms  of  a  complex  correlation  of 
f,(r)  and  *2(r):4 

Ki2(r)  =  (j)  Re  j  JV(x-  rli'jfxldxj 

(18a) 

=  (5)  Re  jexp  I/2ir/0T]  j"  af(x  -  t)o2(x)</x 

(18b) 

=  (5)  Re  {exp  [/2ir/0Tl  r,2(r)} 

(18c) 

=  (i)fii(T)  cos  [2n/oT  +  0i2(r)l 

(18d) 

where 

rl3(  )=  J«f(x- r)«2(x)dx 

(18e) 

f|2(r)“  |r,2(T)l 

(!8f) 

0i2(T)"’»rg{»,i2(T)}- 

(18*) 

4  The  proof  b  relatively  easy  if  it  b  remembered  that  the  analytic 
signal  contains  only  positive  frequency  components. 
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It  should  be  noted  that  a,  and  a2  can  represent  real  baseband 
signals  (which  are  placed  on  a  carrier  for  acousto-optic  modu¬ 
lation)  if  a,  and  ot2  equal  zero  or  pi.  In  that  case,  R (t)  is  a 
pure  amplitude-modulated  carrier  with  the  amplitude  convey¬ 
ing  the  correlation  of  a,(jc)  and  a2(x). 

B  Nonheterodyning  Space-Integrating  Correlator 
In  the  traditional  form  of  acousto-optic  correlator,  the  inte¬ 
gral  of  (IS)  is  an  integration  over  a  spatial  coordinate.  As  a 
first  example  of  a  space-integrating  correlator,  consider  the 
system  of  Fig.  4,  which  evaluates  the  square  of  the  correlation 
envelope  rl2(r).  The  acousto-optic  cell  can  be  operated  in  the 
Bragg  regime,  though  we  assume  Raman-Nath  operation  in 
our  analysis.  The  complex  wave  amplitude  of  the  cell  is  as¬ 
sumed  to  be  given  by  (I)  with  s(x  -  Fr) = r,(x  -  Vt).  The 
spatial  filter  mask  in  plane  P3  is  constructed  to  pass  only  the 
frequency-upshifted  +1  diffraction  component,  and  the  wave 
amplitude  incident  on  the  mask  in  plane  P4  therefore  has  the 
form  (note  that  the  sense  of  the  x-axis  has  been  reversed  in 
this  plane,  consistent  with  the  inversion  undergone  in  imaging 
plane  P2  to  plane  l\  ): 

«inc(*. ')  =  (£)?,•(*-  Vt)  rect  (x/W).  (19) 

The  mask  itself,  which  may  be  a  phototransparency,  is  repre¬ 
sented  by  amplitude  transmittance 

tm(x)=  (I  +rj(x)| 

=  (I  +(l)*2(x)  +  (i)*j*(x)l  (20) 

The  absence  of  a  factor  /  in  the  second  and  third  terms  is 
consistent  with  the  amplitude  modulation  characteristics  of 
photomasks. 

The  wave  transmitted  by  the  mask  has  complex  amplitude 

Rtrnns^i  =  Minc(*i  t)tm(x) 

=  {(i)f*(x-  Ff) +  ($)*,•(*-  Ff>r,<x) 

+  (J)*?(x-  Fr)l?(x)}  ncUx/W).  (21) 

To  within  a  quadratic  phase  factor,  the  final  lens  Fourier 
transforms  this  distribution  and  the  pinhole  samples  the 
resultant  transform  distribution  at  the  origin,  i.e.,  at  zero 
spatial  frequency.  Of  the  three  terms  of  (21),  the  first  con¬ 
tains  spatial  carrier  term  exp  \-i2nf0x  \  and  the  third  contains 
exp  ('/2ir2/o*!'  Only  the  second  term,  corresponding  to  a 
doubly  diffracted  wave  component,  has  spatial  frequency 
content  about  zero  spatial  frequency,  and  the  wave  amplitude 


(c) 

Fig.  5.  Functions  involved  in  correlation  operation. 


at  the  pinhole  is  thus  given  by 

“pinholelfl  =  >  J  **•*  "  I'f)lj(x)  rect  (x/W)  dx  (22) 

Fxcept  for  the  window  function,  this  function  is  proportional 
to  rn(  Vt)  exp  | /2stm0 r  1 .  The  detector  output  icf(f)  is  propor¬ 
tional  to  the  wave  intensity  I  Upshot*  I1  ■  (bus  to  the  extent 
that  the  windowing  effect  of  the  finite  cell  length  can  be 
ignored  (and  droppings  proportionality  constant). 

idU>=  rj,(lf)  (23) 

It  should  be  noted  that  this  system  requires  illumination  from 
a  point  source  because  of  the  pinhole  detection  arrangement. 
The  source  may,  however,  have  broad  spectral  bandwidth, 
subject  to  the  spatial  filtering  requirements  in  plane  Ps 
In  a  closely  related  system,  the  photomask  is  replaced  with 
a  second  acousto-optic  cell,  driven  from  the  bottom  Taking 
the  axis  inversion  into  account,  the  mask  transmittance  then 
becomes 


tm(x,  n  -  I  ♦  il2(x  +  Fr)  +  /*?(*  +  Vt) 


(24) 
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Fig.  6.  Heterodyning  correlator/convolver  with  zero  and  +1  diffraction  component  imaged  on 

reference  mask  tm(x). 


Proceeding  as  before,  we  find  the  detector  output  to  be  pro¬ 
portional  to  rf2(2Ff),  or,  if  the  sound  velocities  are  different, 
to  rJ2|(F,  +  V2)t  |,  where  the  meaning  of  F,  ,  V2  is  obvious. 
Two-cell  systems  are  convenient  in  that  no  photomask  record¬ 
ing  is  required.  It  should  be  noted,  however,  that  if  such  a  sys¬ 
tem  is  to  be  used  to  correlate  electrical  signal  waveforms 
Di  (r)  and  v2(t),  it  is  a  lime-reversed  version  of  u2(t)  that  must 
drive  the  second  acousto-optic  cell.  (This  can  be  seen  by  con¬ 
sidering  the  form  of  the  spatial  pattern  induced  in  the  cell 
that  results,  e.g.,  from  a  frequency-chirped  input  signal.)  In 
certain  cases  a  time-reversed  version  of  v2(t)  may  be  difficult 
to  produce. 

Window-imposed  limitations  on  space-integration  correlator 
(and  convolver)  operation  are  illustrated  with  the  help  of 
Fig.  5,  which  shows  (a)  the  signal  s,  (x  -  Fr)  moving  past  the 
window  function,  (b)the  stationary  phototransparency  signal 
s2(x),  and  (c)  acousto-optic  signal  r2(x  +  Vt)  moving  under  a 
window.  In  order  for  the  window  to  be  ignorable,  signal  s,  (x) 
must  be  no  wider  in  extent  than  window  width  W.  For 
matched  filtering  operations,  this  means  that  the  duration  T  of 
the  signal  to  be  filtered  should  not  exceed  the  acoustic  transit 
time  across  the  cell  W/V.  As  noted  earlier,  this  transit  time 
rarely  exceeds  several  tens  of  microseconds.  For  signals  of 
greater  duration,  only  partial  correlation  is  possible  with  the 
space-integration  method. 

C.  Heterodyning  Correlators 

With  only  minor  modifications,  the  system  of  Fig.  4  can  be 
made  to  yield  the  complete  phase-bearing  correlation  function 
R,2{‘)  as  output,  not  simply  its  envelope  r12(-).  Processors 
that  do  this  are  generally  referred  to  as  heterodyne  processors, 
since  the  information-bearing  carrier  is  produced  by  the  hetero¬ 
dyne  mixing  of  two  optical  waves  at  the  detector.  For  the 
example  shown  in  Fig.  6,  we  allow  the  zeroth  order  to  be 
passed  by  the  spatial  filter  and  replace  the  pinhole  in  front  of 
the  detector  with  an  off-axis  opening  to  pass  one  of  the  dif¬ 
fraction  components.  For  analytical  convenience  we  also 
introduce  a  90°  phase  shift  in  the  +1  diffraction  component, 
although  this  is  not  essential.  Proceeding  as  before  but  includ¬ 
ing  the  zeroth-order  diffraction  component,  we  have  for  the 
wave  field  transmitted  by  the  mask 

«tran»(x,f)=  {[1  +  (A)if(x-  Ft)] 

•  ( 1  +  (^)*2(x)  +  ( 5 )»?(jc)] }  rect  (x/W).  (25) 

Of  the  various  product  terms,  only  the  singly  diffracted  com¬ 
ponents  ( j)**(x  -  Fr)  and  (|)s2(x),  both  of  which  contain 
spatial  carrier  terms  exp  |-/2ir/0x|,  travel  in  the  correct 


nominal  direction  to  pass  the  detector  plane  mask.  Thus  so 
far  as  the  detector  is  concerned,  we  need  consider  only  the 
wave  field 

ud(x,  t)  =  {(i)rr(jc  -  Fr)  +  (±)s2*(x)}  rect  (x/W).  (26) 

Since  the  detector  responds  only  to  the  time  varying  energy 
flow  in  this  wave  field,  we  can  write  for  id (r),  the  detector 
output, 

id(t)  =  f|ud(x,r)|2  dx 


=  (£)  I  ls,*(x-  Ff ) | 2  rect  (x/W)  dx 


+  (*)  |s*(x)|2  rect  (x/W)  dx 


+  (j)  Re  I J  ?|*(x  -  Fr)s2(x)  rect  (x/W)  dxj  .  (27) 

The  third  term  is,  again  to  within  limitations  imposed  by  the 
window  function  rect  (x/W),  the  desired  cross  correlation 
R  l2 ( Fr).  Since  Rn(Vt)  rides  on  a  temporal  frequency  carrier 
p0  =  Vfo .  >1  can  be  separated  by  bandpass  filtering  from  both 
the  second  term,  which  is  at  dc,  and  from  the  first  term,  which 
is  a  baseband  term  with  twice  the  bandwidth  of  the  modula¬ 
tion  a,  (r).  As  before,  a  second  acousto-optic  cell  can  be  used 
for  the  signal  s2  as  well. 

A  characteristic  common  to  all  heterodyning  correlators  and 
convolvers  is  the  mixing  at  the  detector  of  light  waves  with 
optical  frequencies  in  two  distinct  bands  (in  the  above  case 
separated  nominally  by  v0  ).  In  an  alternate  scheme  described 
by  Sprague  in  a  review  of  acousto-optic  correlators  127],  the 
basic  system  of  Fig.  4  is  used,  with  the  spatial  filter  passing  the 
+1  and  -1  diffraction  components  from  the  acousto-optic  cell 
(shifted  by  ±i>0,  respectively)  and  blocking  the  zeroth  order. 
The  complex  amplitude  of  the  light  wave  transmitted  by  the 
mask  is  proportional  to 

')={[({ )f,(x-  Fr)  +  (Jj)if(x  -  Fr)] 

(1  +(j)ij(x)  +  (^)f*(x)]}  rect(jr/H').  (28) 

In  this  case,  only  the  product  terms  ($)f|(x-  Fr)ij(x)  and 
(|)i?(x  -  Ff)s2(x)  have  nominal  propagation  directions  along 
the  r-axis.  Thus  the  complex  wave  amplitude  at  the  on-axis 
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(•) 


(b) 


Fig.  7.  Proximity  imaging,  or  compact  correlator /convolver:  (a)  basic  system;  (b)  diagram  showing 
relative  optical  frequencies  and  origins  of  components  that  reach  detector. 


Fig.  8.  Fourier  plane  heterodyne  processor:  M  =  mirror  and  BS  =  beamsplitter. 


pinhole  is  given  by 

«pinhole(0  =  (i)  J  (?,*(*-  Vt)ll(x) 

+  ?,  (x  -  Vt)if(x))  rect  (x/W)  dx 

-  (£)  Rej  |  *,•(*  -  Vt)l 2(x)  rect  (x/W)  dx  j  . 

(29) 

Ignoring  the  window  effect,  this  is  the  desired  correlation.  The 
detector,  responding  to  the  intensity  of  the  light  at  the  pin¬ 
hole,  has  output 

=f?»(Kf)cosJ  [2trp0f  +  fllJ(Kf)) 

-  (i)fij (VO  +  (\)r2n(vT)  cos  1 2ir2v0 1  +  20i2(Vt)\. 

(30) 

The  second  term,  on  a  carrier,  can  be  extracted  by  bandpass 
filtering.  Some  additional  processing  is  required  to  obtain 
r,2(Kf)  and,  if  desired,  0,2( Vt)  as  final  outputs. 

A  number  of  heterodyne  correlators  have  been  described 
that  do  not  require  the  careful  imaging  of  the  acousto-optic 
cell  onto  the  phototransparency  that  is  characteristic  of  the 
systems  of  Figs.  4  and  6.  An  example  is  illustrated  in  Fig.  7. 


In  this  case  the  cell  and  mask  are  assumed  to  be  sufficiently 
close  together  that  they  can  be  characterized  by  the  product 
transmittance 

fprod(*.  0  =  t(x,t)tm(x) 

’  {[1  +  (±)exp[/0]s,(x-  Vt) 

+  (i)exp  1/0  ]?,*(*-  Vt)] 

■  [1  +(i)?J(x)  +  (i)i?(x)]}rect(x/K'). 

(31) 

The  phase  factor  exp  (/01,  which  depends  on  the  distance 
separating  the  mask  and  the  acousto-optic  cell,  is  chosen  for 
convenience  in  analysis  to  equal  -/.  (For  some  other  choice, 
the  phase  of  the  carrier  of  the  cross  correlation  function 
changes.)  With  normally  incident  illumination  of  the  acousto¬ 
optic  cell,  the  light  that  passes  the  detector  plane  mask  corre¬ 
sponds  to  the  product  terms  containing  spatial  carriers  of  the 
form  exp  [/2ir/0Jt],  or  the  terms  (£)*,(*  -  Vt)  and  (|)?2(x). 
The  energy  flux  associated  with  these  two  waves,  which 
governs  the  detector  output,  is  given  by 

id(»‘  Ji(l>  r,(*-  Kf)  +  (|)i'2(*)|I  rect  ix/W)  dx  (32) 
which  evaluates  to  the  same  form  as  (27). 
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In  order  for  this  kind  of  correlator  (sometimes  referred  to  as 
a  compact  configuration  correlator)  to  function  correctly,  it  is 
necessary  that  the  basic  form  of  the  wavefieid  transmitted  by 
the  acousto-optic  cell  not  change  significantly  over  the  propa¬ 
gation  distance  separating  cell  and  mask.  This  in  turn  imposes 
constraints  on  that  distance  and  on  the  bandwidth  of  the  com¬ 
plex  modulation  « , ( - )  [  14).  This  kind  of  processor  geometry 
has  been  exploited  extensively  by  researchers  at  the  Harry 
Diamond  Laboratory  with  planar  Bragg  mode  acousto-optic 
processors,  typically  with  a  second,  reverse  direction  acousto¬ 
optic  device  replacing  the  phototransparency  128]. 

D.  Fourier-Plane  Heterodyne  Processing 

We  close  this  section  with  a  description  of  one  additional 
type  of  space-integrating  optical  processor,  investigated  by 
Whitman  et  al.  (IS),  that  emphasizes  the  diversity  of  ways  in 
which  acousto-optic  cells  can  be  employed  for  signal  filtering. 
Shown  in  Fig.  8,  this  system  places  the  detector  in  the  Fourier 
transform  plane  of  the  acousto-optic  cell,  behind  a  mask  that 
passes  only  the  - 1  diffraction  component.  Incident  on  the 
detector  are  two  wave  distributions,  one  given  by  the  spatial 
Fourier  transform  of  the  distribution  F,  (x  -  Vt),  the  other- 
referred  to  as  the  local  oscillator  (L.O.)  wave-being  deter¬ 
mined  by  the  nature  of  the  optical  system  in  the  second  arm 
of  the  optical  system.  Letting  £  denote  the  Fourier  plane  co¬ 
ordinate  and  denoting  the  L.O.  wave  (for  reasons  that  will  be¬ 
come  clear)  by  (-j  we  thus  have  for  the  wave  amplitude 

at  the  detector 

U</(?,t)=(i)S1(?)exp[-/27r?Ftl+(i)SJ(-|)  (33) 

where  5,  (|)exp  \-j2n$Vt]  is  the  spatial  transform  of  signal 
distribution  F,  (x  -  Vt).  The  detector  output  is  given  by 

>dV)=  f  !*</(?,  Ol5  d%  (34) 


mixes  with  the  wave  £*(-{)  at  point  |  to  produce  an  out¬ 
put  beat  signal.  This  beat  signal  is  itself  sinusoidal  at  frequency 
vs\  however,  its  magnitude  and  phase  are  governed  by  the 
magnitude  and  phase  of  the  L.O.  wave  at  point  Thus,  S2({) 
plays  the  role  of  a  transfer  function,  leading  to  an  alternate 
point  of  view  of  the  processor.  In  [29],  Korpel  establishes 
various  basic  relationships  between  this  transfer  function  point 
of  view  and  the  convolution  point  of  view.  Recently  Florence 
and  Rhodes  [30]  have  described  a  generalization  of  the 
Fourier  plane  heterodyne  processor  wherein  the  L.O.  wave 
field  varies  in  optical  frequency  as  a  function  of  Fourier  plane 
coordinate  £.  The  mixing  processes  that  result  lead  to  signal 
input-output  relationships  described  loosly  as  a  nonlinear 
mapping  of  signal  frequency  components.  The  method  can  be 
used  for  certain  kinds  of  bandwidth  compression  and 
expansion. 

IV.  1-D  Time-Integrating  Convolvers 
and  Correlators 

A.  Introduction 

Acousto-optic  processors  are  well  suited  to  wide-band  signal 
processing,  with  acousto-optic  correlators  being  particularly 
applicable  to  radar  signal  processing.  Situations  arise,  how¬ 
ever— for  example,  in  direction  finding  of  noise-like  sources- 
where  correlation  times  exceeding  the  transit  time  of  the 
acousto-optic  window  are  desirable  or  necessary.  Extensions 
of  the  basic  space-integrating  methods  discussed  above  have 
been  investigated  where  correlation  times  are  increased  by  the 
use  of  multiple  cells  with  delay  lines  and  by  the  use  of  folded- 
path  acousto-optic  devices  [31].  Especially  important  in  ex¬ 
tending  the  capabilities  of  acousto-optic  devices  has  been  the 
development  of  an  alternate  class  of  acousto-optic  processors, 
known  collectively  as  time-integrating  processors,  that  allow 
integration  times  of  the  order  of  tens  of  milliseconds  and 
greater  [  321—141  ] . 


which,  by  Rayleigh’s  theorem,  can  be  written  as 


l'ct(t)  = 


jl  (£)*,(*-  Kr)  +  (i)F2*(x) I5  dx 


l?2*(*)l2  dx 


s,(x~  Vt)i2(x)  dx 


(35) 


where  t2(x),  the  inverse  spatial  transform  of  S2(f),  is  the 
analytic  signal  associated  with  real  signal  s2  (x).  The  first  term 
of  (35)  is  at  baseband,  the  second  at  dc.  The  properties  of 
analytic  signals  are  such  that  the  third,  or  ac  term,  denoted 
iac(t),  has  the  form  of  a  convolution, 


r,(x-  Vt)s2(x)  dx. 


(36) 


As  a  function  of  time,  this  term  represents  a  filtered  version  of 
the  input  signal  waveform  u,(r),  with  the  filter  impulse  re¬ 
sponse  being  governed  by  the  function  r2(x). 

As  noted  in  (15],  a  signal  u(r)  *  cos  2wJr  input  to  the 
acousto-optic  cell  produces  a  single  spot  of  light,  downshifted 
in  frequency  by  t>s,  at  point  {  *  on  the  detector.  This  spot 


B.  Two-Cell  System 

We  begin  with  a  description  of  the  first  processor  of  this 
class  to  be  developed,  reported  by  Montgomery  in  [32]  and 
illustrated  in  Fig.  9.  Because  time-integration  processing  is 
characterized  by  integrations  with  respect  to  time  rather  than 
space,  we  modify  our  point  of  view  from  that  taken  in  the 
previous  section  and  emphasize  r,  the  integration  variable,  by 
writing  the  acousto-optic  cell  transmittance  directly  in  terms 
of  the  driving  signal  waveforms,  (f)  and  u2(f).  For  con¬ 
venience  of  notation  we  also  move  the  x-axis  origin  from  the 
optical  axis  to  the  bottom  end  of  the  cells.  Under  these  cir¬ 
cumstances,  we  can  write  (omitting  a  modulation  proportion¬ 


ality  constant  and  the  window  function) 

r,(x,  r)  =  exp  [/u,(r- x/F)I  (37a) 

=  [1  +ivx(t-x!V)\  (37b) 

f2(x,r)=exp  l/u2(f +  x/K- D]  (38a) 

ill  +/u2(r  +  x/F-  D]  (38b) 

where 

u,(r)=  h,(t)  cos  [2tri'o +0t  (f>l  (39) 

v2(0  =  b2(f)cos  [2ff»V +  (40) 


In  (38)  the  +  sign  denotes  the  reversed  sound  wave  propaga¬ 
tion  direction,  and  Tis  the  cell  transit  time  WjV. 
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Fig.  9.  Example  of  a  two-cell  time-integrating  correlator/convolver.  Raya  thow  directions  of  principal 

diffraction  components. 


As  before,  we  introduce  the  analytic  signal  representations 


for  Pi ,  v2 ,  writing 

p,(f)=  Re  {«,(/)}  (41) 

Pj(r)  =  Re  {p2(f)}  (42) 

where 

Pi  (f)  =  f>i  (/)  exp  [/0i(r)]  exp  [/2jrp0fl  (43a) 

=  ft,  (r)  exp  [/2jrp0f]  (43b) 

ff2( t)  =  b2(t)  exp  [/(3i(f)]  exp  [i2iv0t]  (44a) 

=  b2(t)  exp  ( /2ttp0  t ] .  (44b) 

In  terms  of  the  analytic  signals,  the  transmittance  functions 
become 

r,(x,f)=  {1  +  / ( i ) p, (f  -  x/ K)  +  /( ^ ) P,*(f  -  x/ K)}  (45) 


rJ(x,r)=  {1  +j^)v2(t+xlV-  p?(r+x/K-  D}. 

(46) 

Although  the  notation  has  been  changed  from  that  of  Section 
III,  it  is  important  to  note  that  the  analytic  signal  terms  P] ,  p2  , 
p*,  and  u*  correspond  directly  to  the  acoustic  wave  terms 
F, ,  i2 ,  if,  and  of  earlier  analyses.  Specifically,  as  functions 
of  x  they  lead  to  the  same  diffracted  wave  components  as  be¬ 
fore  and  can  be  filtered  out  by  appropriate  spatial  filter  plane 
stops. 

As  a  function  of  the  real  signals  pt(f)  and  v2(t),  the  cross¬ 
correlation  function  R,2(t)  has  the  form 

R12(t)  =  Jp|(f  r)v2(t)dt  (47) 

which  in  terms  of  the  analytic  signals  can  be  written  as 

«,2(r)  =  (|)RejJ  r)pj(f)<ff|  (48a) 

=  ($)  Re  {exp  (/2jTF0rl  rI2(r)}  (48b) 

where 


rnir) 


■Jk 


(t-  r)*2(f)  dt. 


(49) 


In  practice,  the  two  cells  of  Fig.  9  are  typically  operated  in 
the  Bragg  regime  with,  for  example,  cell  1  being  rotated 


clockwise  and  cell  2  being  rotated  counterclockwise  through 
the  Bragg  angle.  Under  these  circumstances,  the  conjugated 
terms  of  (45)  and  (46)  are  suppressed,  and  the  product 
transmittance  has  the  form 

fp,od(*.0=[l  +/<i>®i(*-*/K)Hl  +/($>5a(f  +  x/K-  Dl. 

(50) 

If  the  cell  pair  is  illuminated  by  a  nominally  collimated  light 
beam,  the  pair  of  openings  in  the  pupil  plane  mask  pass 
only  diffraction  components  corresponding  to  the  terms 
/(^)i»,(f-  x/V )  and  /(^)u2(f  +  x/V -  T),  with  a  resultant  de¬ 
tector  plane  intensity  distribution  given  by 

/d(x,  t)  =  | /<$)»,  it  -  x/V)  +  i({)v2(t  +  x/V  -  T)|J 
=  (i)|K,(f-x/K)|2  +(i)|i >2(t  +  xlV-  Dl* 

+  (i)Re  {v*(t- xlV)V2(t  +  xlV-  T)}.  (51) 

The  detectors  in  the  output  plane  array  perform  the  integra¬ 
tion  with  respect  to  time,  integrating  charge  at  a  rate  propor¬ 
tional  to  the  incident  light  intensity.  Thus  letting  E&j-  denote 
the  light  energy  delivered  at  point  x  on  the  detector  array 
during  an  interval  of  time  T,  the  output  of  the  integrating 
detector  at  x  is  proportional  to 

E^T(x)  =  (?)  f  M (t  -  *IV)  *  +  (i)  f  b\(t  +  x/V  -  T)  dt 
J&T 

+  ($)RejJ  S?(f-x/K)?2(f  +  x/F-  T)dt 

(52) 

To  the  extent  that  AT  can  be  assumed  infinite,  the  first  two 
terms  of  this  expression  evaluate  to  constants  and  the  third  to 
the  desired  correlation;  thus, 

EtT(x)~bin  +  Ri2(2xlV-  T).  (53) 

In  practice,  integration  times  are  limited  by  dark  current, 
which  ultimately  saturates  the  linear  response  of  integrating 
photodetectors.  Nevertheless,  as  suggested  earlier,  integration 
times  of  tens  of  milliseconds  are  possible  with  low  noise  CCD 
photodetector  arrays,  and  these  times  can  be  extended  by 
post-detection  digital  integration.  The  acousto-optic  window 
no  longer  limits  the  signal  duration,  but  it  does  impose  a 
restriction  on  the  correlation  variable  r,  limiting  it  to  the  range 
0  <  r  <  H'/K.  This  restriction  can  present  difficulties  in  certain 
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Fig.  10.  Zeroth-order  depletion. 


Fig.  1 1.  Single-cell  time-integration  system.  Dotted  line  in  spatial  filter  denotes  phase  shifter. 


areas  of  application  when,  for  example,  relative  time  delays 
between  signals  are  unknown.  Perhaps  the  major  limitation 
of  time-integration  processors  is  the  presence  of  the  bias  terms 
that  attend  the  desired  correlation  function.  These  terms  also 
drive  the  integrating  detectors  toward  saturation  and,  because 
thev  are  signal  dependent  (both  as  functions  of  time  and  of 
space),  may  be  difficult  to  compensate  with  post-detection 
processing.  In  spite  of  these  bias  terms,  however,  excellent 
processing  gain  is  achievable  with  time-integration  methods 
when  applied  to  matched  filtering  operations  (27] . 

A  possible  drawback  of  the  two-cell  system  just  discussed 
relates  to  a  phenomenon  known  as  zeroth-order  depletion. 
The  basic  idea  is  illustrated  graphically  in  Fig.  10,  which  shows 
a  bandpass  acoustic  wave  diffracting  light  in  the  Bragg  regime. 
Where  the  acoustic  wave  is  weak,  low-efficiency  diffraction  of 
the  incident  beam  has  relatively  little  effect  on  the  intensity 
of  the  undiffracted  component  of  the  output.  With  high  dif¬ 
fraction  efficiency,  however,  a  sufficiently  large  fraction  of 
the  incident  wave  is  diffracted  that  the  zeroth  order-that  part 
of  the  wave  field  that  is  to  be  diffracted  by  the  second  cell— is 
modulated  both  temporally  and  spatially  rather  than  being 
constant.  High  diffraction  efficiency  operation  results  in 
reduced  accuracy  because  of  this  phenomenon. 


illumination  is  modulated  by  signal  u2(r),  such  that 

fillum(')  =  B  +  uj(r),  (54) 

where  B  is  a  bias  sufficiently  large  to  keep  the  sum  IB  +  o2(f)l 
nonnegative.  The  detector  plane  intensity  is  thus  given  by 

/<*(*,  0  =  /iilum(f)|l  +  (j)*i('  -  */»7|* 

=  (B  +  uj(f)l(l  +(i)f»i(f-  x/n  +  I»i(f  *  x/m  (55) 
with  associated  time-integrated  intensity 


£-A7.(x)  =  BAT+  { BvtU-x/V ) 

J\T 

+  uj(0(l  +(i)b?(f-x/K)}</f 

+  f  u,(t  -  xlV)vt(t)  dt. 

•'ar 


(56) 


The  first  term  in  this  expression  is  a  spatially  uniform  bias, 
which  builds  up  with  the  integration  time  AT;  the  second  term, 
being  governed  by  an  integrand  at  the  carrier  frequency  v0,  is 
negligable  for  AT»  \/v0.  The  third  term,  for  AT  sufficiently 
large,  is  the  desired  correlation  Rn(')  as  a  function  of  x/V. 


C.  One-Cell  System 

Fig.  1 1  shows  an  alternate  time-integration  correlator,  of 
a  type  described  by  Turpin  [34]  and  by  Kellman  (35],  that 
overcomes  the  zeroth-order  depletion  limitations  of  the  two¬ 
cell  system  and  is  generally  simpler  to  implement.  The  acousto¬ 
optic  cell,  Uluminated  with  light  from  an  LED  or  laser  diode, 
is  driven  from  the  top  by  signal  i/|(f)  and  imaged  onto  the 
integrating  detector  array.  The  spatial  filter  plane  mask  shifts 
the  phase  of  the  zeroth  order  by  90°  and  blocks  the  frequency- 
downshifted  diffraction  component.  The  intensity  of  the 


D.  One-Cell  System  with  Electronically  Inserted  Reference 
We  note  briefly  a  method  suggested  by  Kellman  for  increas¬ 
ing  the  versatility  and  convenience  of  time-integration  acousto¬ 
optic  processors.  The  system  employed  is  a  simple  modifica¬ 
tion  of  that  of  Fig.  1 1,  in  which  input  signal  ut(r)  is  replaced 
by  signal 

u'lfO  *  hi(0  cos  (2ii(Fo  +  »V)f  +  0i(f)l  cos2*Vof  (57) 

obtained  from  vt(t)  by  shifting  the  carrier  frequency  by  an 
amount  vc  and  adding  a  cosine  signal  at  that  same  frequency. 
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With  v\(t)  as  the  input,  the  acousto-optic  cell  transmittance, 
assuming  Bragg  regime  operation,  is  given  by 

'(*,  t )  =  1  +HA  +  (£)?t(r  -  xlV )]  exp  [j2m>c(t  -  x/V)) .  (58) 

ne  cell  is  illuminated  as  before  by  the  modulated  diode  and 
imaged,  this  time  with  a  zeroth-order  stop.  The  resultant 
detector  plane  intensity  is  given  by 

Id(x,  0  =  [B  +  Mr)l  \A  +  (£)S,(r  -  x/K)|2 

=  [B  +  wi(f)l  I  A2  +  ($)b\(t  -  x/V)  +  Av,  (t  -x/V)). 

(59) 

Assuming  AT  »  \/v0,  the  associated  time-integrated  intensity 
is  approximated  by 

Eat(x)  =  A2BAT  +  A  I  Mr-  X/V)v2(t)dt  (60) 

Jat 

which  is  similar  to  the  results  for  the  previous  system  (which 
corresponds  to  setting  A  equal  to  unity),  but  now  the  ratio  of 
the  correlation  term  to  the  bias  term  is  proportional  to  A~l 
and  can  therefore  be  adjusted  for  optimum  system  perfor¬ 
mance  (40]. 


E.  Linear  Intensity  Modulation  Method 

As  our  final  example,  we  describe  a  time-integration  cor¬ 
relator/convolver  that  represents  a  significant  departure  from 
the  other  systems-both  time-integrating  and  space-integrating  - 
that  we  have  considered  to  this  point.  The  scheme,  described 
by  Sprague  and  Koliopoulos  [33] ,  relies  on  characteristics  of 
acousto-optic  cells  operating  in  the  Bragg  regime  at  high  dif¬ 
fraction  efficiencies.  For  an  acousto-optic  modulator  with 
sinusoidal  driving  signal  v(t )  =  b  cos  2m>0t,  the  intensity  of  the 
diffracted  wave  I  ant  for  Bragg  regime  operation  is  given  by 
/jiff  =  /jiium  sin2  (Kb),  where  /uium  is  the  intensity  of  the 
incident  light  and  K  is  a  constant.  For  low  diffraction  effi¬ 
ciency,  Kb  «  1  and  I^tt  is  approximately  equal  to  (Kb)2, 
consistent  with  our  earlier  analyses.  In  Sprague’s  scheme,  the 
driving  signal  is  of  the  form  v(t)  =  [i0  +  *i(f)]  cos  2m>at, 
where  b0  is  chosen  so  as  to  place  operation  in  the  linear  por¬ 
tion  of  the  sin2  curve;  i.e.,  Kb0  =  rr/4.  Under  these  circum¬ 
stances,  the  diffracted  wave,  modulated  both  temporally  and 
spatially,  has  the  form 

W*.  'Wiiium  sin’  [*(*o  +  M'  -  x/V))] 

-  /ilium  ((£)  +  -*/K)].  (61) 

The  illuminating  beam  is  modulated  according  to 

/ilh.m(f)  =  B  +  M/)  (62) 


and  the  acousto-optic  cell  is  imaged  onto  the  detector  plane 
with  only  the  diffracted  component  passed.  The  resultant 
detector  plane  distribution  is  thus 

/„(*,  t)  =  (fl  +  Mr)]  l(y)  +  -  x/V)]  (63) 

with  integrated  intensity 

EtT(x)-(\)BAT+  f  l(i)b3(t)  +  KBb,(t-x/V)1  dt 
J&T 


+  K 


bi(t-xlV)bt(t)dt 


(64) 


x 


Fig.  12.  Cross-ambiguity  processor:  Input  cell  geometry. 

which  consists  again  of  a  bias  plus  the  desired  correlation  term. 
Because  Kbt(t )  is  small,  the  signal-to-bias  ratio  of  the  output 
distribution  is  itself  relatively  low. 

V.  Extensions  to  Two  Dimensions 
Although  the  great  majority  of  acousto-optic  processors  have 
1-D  inputs  and  1-D  outputs,  certain  2-D  processing  operations 
are  possible.  The  classic  example  of  2-D  acousto-optic  pro¬ 
cessing  involves  the  use  of  astigmatic  imaging  systems  to  allow 
multiple  1-D  correlations  or  convolutions  to  be  performed  in 
parallel  in  a  channelized  system  [3],  Systems  employed  are 
straightforward  extensions  of  the  space-integrating  systems 
discussed  in  Section  HI,  but  the  image  of  the  1-D  acousto¬ 
optic  cell  signal  s(x  -  Vt)  is  spread  out  in  the  y-direction  to 
illuminate  a  mask  transparency  that  varies  not  only  with  x  but 
also  with  y.  The  single  output  plane  mask  and  detector  be¬ 
come  multiple  masks  and  detectors  at  different  distances 
above  the  jc-axis. 

A  reasonably  sophisticated  2-D  acousto-optic  processing 
operation  on  a  pair  of  1-D  signals  is  the  evaluation  of  the  cross¬ 
ambiguity  function.  Given  two  analytic  signals  ti|(r)  and  v3(t), 
their  cross-ambiguity  function  is  given  by 

Tu (r,  v)  =  -  f)?,(r)  exp  [/2nw]  dt  (65) 

which  can  be  viewed  as  the  complex  correlation  of  5j(f)  with 
a  frequency-shifted  version  of  ?j(f).  A  space-integration 
acousto-optic  implementation,  described  by  Said  and  Cooper 
[  42] ,  is  explained  with  the  help  of  Fig.  1 2.  The  two  real  band¬ 
pass  signals  vt(t)  and  v2(t)  are  input  to  a  pair  of  crossed  cells, 
with  propagation  directions  at  45°  to  the  x-y  axes.  The  com¬ 
plex  amplitude  transmission  of  the  acousto-optic  cell  pair  is 
given  by  (ignoring  the  effect  of  the  window) 

tptirix.y.O’’  [1  +/M\/2  [x+y-  Ff])] 

•  [l+/*a(V2  (x-y  -  Kf])].  (66) 

The  cell  pair  is  illuminated  with  a  nominally  collimated  light 
beam  and  imaged,  with  all  but  one  (doubly)  diffracted  wave 
component  being  stopped  by  a  spatial  filter  plane  mask.  The 
transmitted  component  has  the  form 

y,  0  -  tf( >/2  (x  +  y  -  Vt )  )*f( y/2  (x  -  y  -  Vt) ). 

(67) 

To  pass  this  component,  the  spatial  filter  must  consist  of  an 
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Fig.  1 3.  Time-integration  cross-ambiguity  processor  schematic. 


opaque  mask  with  an  opening  shifted  vertically  off  axis.  The 
wave  distribution  «trans(*.>'.  0  ‘s  now  acted  on  by  an  astig¬ 
matic  lens  system  that  images  in  the  vertical  direction  while 
Fourier  transforming  in  the  horizontal  direction  (3).  The 
resultant  output  wave  amplitude  is  given  by 

uout(u,y,t)=  fl7(V2 ]x+y-  Vt])s2(y/2lx  -  y  -  Vt» 

•  exp  [/2tr«x]  dx  (68) 

which  equals  T,j(2  \f2  y,  u),  as  long  as  both  signals  are  within 
the  aperture.  The  observed  intensity  is  the  squared  modulus 
of  this  distribution;  if  phase  is  to  be  preserved,  interferometric 
means  can  be  used. 

An  area  of  considerable  current  interest  is  the  application  of 
time  integration  acousto-optic  techniques  to  2-D  signal  pro¬ 
cessing  applications  1 3-4 J ,  [37],  (39).  We  illustrate  with  a 
system  described  by  Turpin  (34)  for  cross-ambiguity  function 
calculation.  Fig.  13  is  a  schematic  representation  of  this  sys¬ 
tem,  greatly  simplified  to  illustrate  the  concept,  not  the  optics. 
(The  actual  system  is  too  complicated  optically  to  illustrate 
easily,  requiring  a  combination  of  spherical  and  cylindrical 
lenses  as  well  as  spatial  filtering  masks  to  remove  unwanted 
diffraction  components.)  Light  from  the  laser  source,  split  by 
a  beamsplitter,  travels  through  two  subsystems  to  be  recom¬ 
bined  interferometrically  in  the  output  plane.  In  the  upper 
subsystem,  the  laser  beam  is  first  modulated  in  complex  am¬ 
plitude  by  an  acousto-optic  modulator,  which  is  driven  by 
narrow-band  signal  v2(t).  The  output  of  the  acousto-optic 
modulator  is  a  light  beam  (a  single  diffraction  component 
from  the  cell)  with  complex  amplitude  v2  (/)■  This  beam  is 
expanded  in  the  horizontal,  or  x  direction  and  recollimated  so 
as  to  illuminate  the  entire  width  of  the  second  acousto-optic 
cell.  The  output  of  this  second  cell,  which  is  driven  by  signal 
vi(f),  is  expanded  and  recollimated  in  the  vertical  direction 
and  imaged  with  appropriate  spatial  filtering  in  the  horizontal 
direction.  The  result  in  the  output  plane  is  a  complex  wave 
amplitude  distribution  given  by  v*(t  -  x/F)uj(f).  Note  that 
as  a  function  of  output  plane  coordinates  this  distribution 
varies  only  in  the  x  direction. 

Also  incident  on  the  output  plane  is  the  light  wave  produced 
by  the  second  subsystem.  This  wave  is  planar  and  is  incident 


at  an  angle  that  varies  linearly  with  time  in  the  y  direction  and 
is  constant  in  the  x  direction.  Such  a  wave,  described  analyti¬ 
cally  by  exp  \-j2mxyt]  exp  [-/27rfix] ,  where  a  and  0  are  con¬ 
stants,  can  be  produced  by  driving  the  third  acousto-optic  cell 
with  a  sinusoid  that  is  ramped  linearly  in  frequency -a  chirp. 

The  interference  of  the  waves  from  the  two  subsystems  pro¬ 
duces  the  intensity  distribution 

f<j(x,  y,  t )  =  |u*(t  -  x!V)v2(t)  +  exp  (-j2nayt) 

■exp(-f2npx)\i 

=  |?f(f-  x/V)d2(t)\2  +  1 

+  2  Re  {exp  U2irax)v*(t  -  x/V)v2(t) 

■  exp  (/2fl0yr)}.  (69) 

If  this  distribution  is  integrated  with  respect  to  time,  the  third 
term  yields 

2  Re  (exp  (j2mxx)v*(,t  -  x/V)v2(t )  exp  (j2irQyt)}. 

Assuming  that  the  constant  a  is  sufficiently  large,  this  distribu¬ 
tion  takes  the  form  of  a  sinusoidal  fringe  pattern  whose  magni¬ 
tude  and  phase  carry  the  magnitude  and  phase  of  the  cross- 
ambiguity  function.  Specifically,  assuming  A T  to  be  large,  the 
integrated  output  intensity  is  given  by 

E^T(x,  y )  =  Was  +  2 \Vu(x/V,  y)| 

•  cos  ( 2»rax  +  arg  { Vi2(x/V ,  y)}] .  (70) 


It  should  noted  that  the  accompanying  bias  distribution  is 
a  function  of  spatial  variable  x.  However,  this  distribution 
is  spatially  low  pass  in  nature.  If  the  output  distribution  is 
scanned  with  a  television  camera  (the  camera  itself  performing 
the  time  integration),  the  output  video  signal  will  contain  a 
low-pass  component,  which  can  be  filtered  out,  and  a  bandpass 
component,  which  conveys  the  desired  ambiguity  function. 
The  tilting  plane  wave  from  the  lower  subsystem  must  be 
“restarted"  periodically.  Assuming  it  switches  back  to  its 
starting  angle  instantaneously,  there  are  certain  values  of  y  for 
which  the  optical  phase  of  the  wave  changes  continuously  with 
time.  For  other  values  of  y,  however,  the  phase  function 
exp  (-/2rr0yr]  has  periodic  discontinuities  as  a  function  of  time. 
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Fig.  14.  2-D  triple  product  time-integration  processor.  Spatial  filtering  masks  not  shown. 


Only  for  those  values  of  y  for  which  the  wave  phase  changes 
continuously  as  a  function  of  time  is  the  desired  ambiguity 
function  produced.  In  essence  the  periodic  tilts  of  the  plane 
wave  introduce  a  comb  filter  effect  in  the  signal  analysis.  The 
total  number  of  discrete  frequencies  represented  by  the  comb 
can  be  shown  to  equal  the  time-bandwidth  product  of  the 
third  acousto-optic  cell. 

The  scheme  just  described  is  complicated  somewhat  by  the 
interferometer  nature  of  the  system.  Not  only  must  a  laser 
be  used  as  the  light  source,  but  system  construction  must  be 
interferometrically  stable.  Kellman  has  investigated  a  class  of 
2-D  time-integration  processors  based  on  a  simpler,  imaging- 
type  architecture  [40],  Fig.  14  shows  the  basic  form  of  such 
systems.  In  essence,  the  two  acousto-optic  cells  of  the  system 
are  imaged  onto  each  other  and  onto  the  output  plane,  which 
contains  a  2-D  array  of  integrating  photodetectors.  Intermedi¬ 
ate  spatial  filtering,  not  shown  in  the  figure  for  simplicity, 
leads  to  a  term  in  the  output  plane  intensity  distribution  that 
is  given  by 

/(*,  y,  t )  •  u,(f)ua(f  -  x/V)v3(t  -  y/V).  (71) 

The  integrated  intensity,  as  a  function  of  x  and  y,  is  thus  given 
by 

>0  =  bias  +  I  MOM'- x/y}v3(t- y/V)dt.  (72) 
J&T 

Depending  on  the  form  of  U|(r),  i>2(t),  and  v3 (f),  this  system, 
refered  to  as  a  triple  product  processor,  can  be  used  for  cross- 
ambiguity  calculation  or  for  large  time-bandwidth  product 
spectrum  analysis  (see  [18]). 

We  close  this  section  with  a  description  of  a  2-D  image  pro¬ 
cessing  technique  currently  under  investigation  by  the  author 
(43]  that  can  be  performed  using  acousto-optic  devices.  The 
operation  of  the  overall  system  is  shown  schematically  in 
Fig.  15:  fix,y)  represents  the  input  image  and  h(x,y)  the 
spatial  impulse  response;  the  output  gix,  y)  is  given  by  the 
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Fig.  IS.  Image  processing  system. 


2-D  convolution  gix,  y)  =  fix,  y)  •  h(x,  y).  An  essential  feature 
of  the  system  operation  is  the  conversion  (invertible  through 
sampling  relationships)  from  2-D  to  1-D  signal  representations 
and  back  again.  The  acousto-optic  system  employed  for  input 
and  output  conversion  serves  the  purpose  of  producing  a  set 
of  sinusoidal  fringes.  These  fringes,  with  intensity  I  fix,  y  \t)~ 
1  +  cos  [«of  +  2ir(ux  +  uy)] ,  result  from  the  interference  of 
light  from  a  pair  of  mutually  coherent  light  spots.  These  light 
spots  are  scanned  in  orthogonal  directions  by  acousto-optic 
beam  deflectors  to  produce  fringes  of  controllable  spatial  fre¬ 
quency.  Depending  on  the  relative  temporal  frequencies  of  the 
two  spots  (also  determined  acousto-optically)  the  fringes  may 
be  stationary  (<o0  =  0)  or  moving  with  constant  phase  velocity 
(wo  ^  0). 

Consider  the  input  conversion  operation  first.  We  assume 
that  the  image  to  be  processed  fix,  y)  exists  as  the  intensity 
transmittance  of  a  photo  transparency.  (It  is  significant  that 
fix,  y)  is  the  intensity  transmittance,  as  opposed  to  the  com¬ 
plex  wave  amplitude  transmittance,  of  the  transparency,  for 
this  means  that  the  system  is  insensitive  to  such  things  as 
emulsion  thickness  variations  and  the  severely  limited  dynamic 
range  of  wave  amplitude  spatial  light  modulators.)  This  pboto- 
transparency  is  transilluminated  by  the  fringes  and  the  trans¬ 
mitted  light  collected  by  a  large  photodetector.  The  detector 
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output  is  given  by 

J</(f)=  ^ f(x.y)If(x.y  \t)dx  dy.  (73) 

This  signal  consists  of  a  dc  bias  plus  an  ac  term,  at  frequency 
co0,  given  by 

s f(t)  =  \F(u,  u)|  cos  (w0t  +  arg  {F(u,  u)}] 

=  Re  {exp  (~jcj0t)F(u,v)}  (74) 

where  F(u,v)  denotes  the  2-D  Fourier  transform  of  f(x,y). 
As  u  and  v  are  varied  by  changing  the  inputs  to  the  acousto¬ 
optic  beam  deflectors,  Sf(t)  conveys  sequentially  on  a  temporal 
carrier  the  magnitude  and  phase  of  the  spatial  transform  of 
f(x,  >').  In  practice,  u  and  v  are  scanned  in  a  raster  or  spiral 
scan  so  as  to  effectively  sample  the  entire  transform  F(u,  v). 
Scanning  is  sufficiently  slow  that  Sf(t)  is  a  narrow-band  signal. 

The  electrical  signal  waveform  s> ,(r)  can  be  generated  in  the 
same  way  or  it  can  be  stored.  In  any  case,  we  assume  it  to 
have  the  form 

ShU)  =  I H(u,  u)|  cos  [cj0t  +  arg  { H(u ,  u)})  (75) 

where  u  and  v  are  again  scanned  with  time  ( u  =  u(t),  u  =  u(r)) 
and  where  H(u,  v )  is  the  2-D  Fourier  transform  of  impulse 
response  h(x,  v). 

The  electrical  processing  system  of  Fig.  1  5  consists  of  an 
analog  multiplier  followed  by  a  bandpass  filter  tuned  to  the 
double  frequency  2cj0-  The  output  of  the  filter  thus  has 
the  form 

sg(t)  =  IG(u,  v)l  cos  [2co0t  +  arg  { G(u,i>)})  (76) 

where 

G(u,v)  =  F(u.v)H(u,v )  (77) 

i.e.,  sg(r)  conveys  the  magnitude  and  phase  of  the  product  of 
the  transforms  of  f(x,  y)  and  h(x,  y)  and,  therefore,  corre¬ 
sponds  to  the  time-signal  representation  of  the  desired  output 
g(x,y). 

In  order  to  produce  output  intensity  distribution  g(x,  y) 
from  signal  waveform  sg(t),  a  second,  synchronized  acousto¬ 
optic  system  is  used  to  produce  a  fringe  pattern  of  the  form 

Ig(x,y,  t)  *  |G(u,  v)|  {1  +  cos[2jr(y*  +  uy)  +  arg  {G(a,  u)}]} 

(78) 

where  u  and  u  are  implicit  functions  of  time.  Noting  that  an 
integration  with  respect  to  time  corresponds  to  an  integration 
with  respect  to  a  and  v,  the  time-integrated  intensity  distribu¬ 
tion  / Ig(x,y)  dt  is  easily  shown  to  equal  a  bias  plus  the  (real) 
distribution  g(x,y).  Contrast  is  low,  but  computer  simula¬ 
tions  have  shown  it  to  be  adequate  foi  many  applications. 

VI.  Concluding  Remarks 

This  paper  has  surveyed  the  major  techniques  developed  to 
date  for  effecting  signal  convolutions  and  correlations  with 
acousto-optic  devices.  The  emphasis  has  been  on  a  Fouiier 
optics  point  of  view;  distinctions  between  different  possible 
modes  of  operation -Bragg  regime,  Raman-Nath  regime,  linear 
in  wave  amplitude,  linear  in  wave  intensity,  phase  preserving, 
etc.-have  received  major  emphasis  in  hopes  of  avoiding  pos¬ 
sible  confusion.  Although  the  treatment  is  by  no.  means  ex¬ 
haustive,  it  should  serve  as  an  adequate  basis  for  an  under¬ 


standing  of  most  of  the  literature  in  this  field.  The  support  of 
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III.  THE  FALL INS  RASTER  IN  TIME-INTE6RATI0N  FOLDED  SPECTRUM 
ANALYSIS 


CAn  excerpt  from  “The  Falling  Raster  in  Optical  Signal 
Processing,"  to  be  published  in  Tr^n^f ormatiQDS  in  Optical  Si.gr»al 
Processing ,  W.  Rhodes,  J.  Fienup,  and  B.  Saleh,  eds.  (SPIE, 
Bellingham,  1982|  Volume  2  in  Advanced  Institute  Series).! 

In  optical  processing  we  usually  associate  the  falling  raster 
with  space-integration  folded  spectrum  analysis.  However,  it  also 
plays  a  critical  role  in  the  folded  spectrum  analysis  of  1— D 
signals  using  iigig-integratian  optical  processing  methods  Cll— 183. 
In  this  section  we  consider  this  aspect  of  the  falling  raster, 
starting  with  what  we  have  found  to  be  an  extremely  useful  analogy 
between  time-integration  optical  spectrum  analysis  and  incoherent 
holography. 

A.  Incoherent  Holggraghy  Analogy 

In  Fig.  9a  we  show  a  conventional  coherent  optical  spectrum 
analyzer  with  falling  raster  input  and  folded  spectrum  output. 
Consider  now  the  situation  shown  in  Fig.  9b,  where  the  raster 
recording,  rather  than  being  uniformly  illuminated,  is  scanned, 
line  by  line.  Clearly  a  folded  spectrum  cannot  result  from  such 
an  operation,  since  at  any  time  wave  intensity  in  the  back  focal 
plane  of  the  lens  is  uniform.  If,  however,  as  shown  in  Fig.  9c,  a 
reference  wave,  mutually  coherent  with  the  scan  wave,  is 
introduced  by  focusing  a  spot  off  axis  in  the  raster  plane,  the 
output-plane  intensity  will  at  any  time  consist  of  a  sinusoidal 
fringe  pattern.  If  photographic  film  in  that  plane  integrates  the 
incident  intensity  pattern  as  the  raster  is  scanned,  the  result 
is,  in  most  aspects,  equivalent  to  a  Fourier  transform  hologram  of 
the  raster  record.  Specifically,  each  sample  value  along  the 
raster  (and,  therefore,  each  sample  in  time  of  the  waveform  f(t>) 
is  mapped  into  a  sinusoidal  fringe  pattern  whose  amplitude  (and, 
if  the  raster  is  complex-valued,  phase)  is  determined  by  the 
(complex)  amplitude  of  the  sample.  So  long  as  the  focused 
reference  point  is  sufficiently  far  off  axis,  each  such  fringe 
pattern  is  character i zed  by  a  unique  spatial  frequency. 

In  Fig.  9d,  the  situation  is  similar,  except  that  now  the 
raster  record  has  been  removed  and  the  scanning  beam  is  modulated, 
e.g.,  by  an  electro-optic  modulator,  as  it  scans.  So  long  as  the 
scanning  beam  is  modulated  in  time  in  the  same  way  as  it  would  by 
transmission  through  the  raster  recording  itself,  the  result  4 n 
the  output  plane  is  the  same  time-integrated  fringe  pattern  as  for 
Fig.  9c.  Note  that  an  identical  time-integration  pattern  will 
result  if  it  is  the  scanned  light  spot  that  has  the  constant 
amplitude  and  the  non-scanned  spot  that  varies  as  f(t).  Indeed, 
one  beam  can  vary  in  amplitude  as  a(t>  and  the  other  as  b(t), 
again  with  the  same  result,  so  long  as  a(t)bt(t)  ■  f <t). 

The  system  of  Fig.  9d  contains  all  the  essential  features  of 
an  interferometric  2-D  time-integration  spectrum  analyzer  for  1-D 
signal ss  a  scanner  executing  a  falling  raster,  a  modulator,  a 
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reference  source,  and  a  time-integrating  detector  to  record  or 
otherwise  measure  the  integrated  fringe  pattern  that  builds  up 
with  time  in  the  output  plane.  In  practical  systems  the  detector 
is  a  CCD  array  or  a  TV-type  camera. 

The  resemblance  the  output  of  this  system  bears  to  a  Fourier — 
transform  hologram  of  the  raster  record  merits  special  emphasis. 

In  Fig.  9e  a  conventional  <i.e. ,  no  time  integration)  Fourier — 
transform  hologram  recording  setup  is  shown.  Both  this  system  and 
the  time  integration  system  of  Fig.  9d  produce  the  same  bandpass 
structure  in  the  recorded  output.  Ignoring  unimportant  low 
spatial  frequency  structure,  the  time  integration  system  can  oe 
said  to  record  a  hologram  of  the  folded  spectrum  associated  with 
the  raster  signal.  Since  the  hologram  is  of  the  off-axis 
reference  kind,  both  magnitude  and  phase  of  the  folded  spectrum 
are  preserved. 

At  the  same  time,  there  is  an  extremely  important  difference 
between  the  conventional  space-integration  Fourier  transform 
hologram  of  Fig.  9e  and  the  time— integration  pattern  of  Fig.  9ds 
bias.  With  space  integration,  all  points  on  the  raster  are 
illuminated  simultaneously,  and  a  relatively  high  contrast 
hologram  can  result.  With  time  integration,  on  the  other  hand, 
each  fringe  pattern  is  produced  separately,  and  each  carries  its 
own  bias.  This  latter  situation  is  directly  analogous  to 
incoherent  holography,  where  only  low  contrast  holograms  result 
when  objects  of  large  space-bandwidth  product  are  recorded  via 
incoherent  holography  C193.  This  bias  problem  is  severe. 

However,  as  we  discuss  elsewhere  1203,  significant  improvements  in 
si gnal — to~bi as  ratio  are  possible  if  the  time-integration 
recording  system  is  modified  to  produce  fringes  that  always  have 
unity  visibility.  Related  techniques  can  be  applied  to  n on- 
in  ter  ferometri  c  time-integration  systems  with  similar  improvement 
in  signal-to-bias  ratio. 

B.  Distribute^  Lo££l  Oscillator  Point  of  Vjpw 

The  holographic  point  of  view  presented  above  differs  from 
that  generally  taken  by  other  authors.  Indeed,  there  are  many 
different  ways  of  viewing  time-integration  optical  processing, 
each  providing  its  own  particular  insight.  In  his  original  paper 
on  the  subject  C113  and  in  his  article  in  this  volume  C183,  Turpin 
emphasizes  the  concept  of  a  spatially  distributed  local  oscillator 
array.  Figure  10  helps  clarify  the  relationship  between  the 
holographic  and  the  local  oscillator  points  of  view.  In  that 
figure,  it  is  the  scanned  light  spot  that  is  constant  in  amplitude 
and  the  non-scanned  spot  that  varies  as  f(t>.  Clearly  the  time- 
integration  fringe  pattern  that  results  is  the  same  as  that 
obtained  with  the  system  of  Fig.  9d.  However,  rather  than  being 
described  as  a  buildup  of  fringe  patterns,  the  time-integration 
process  is  now  described  in  terms  of  a  gi&iag,  in  the  output 
plane,  of  a  wave  with  complex  amplitude  f <t)expCi2*u3  with  a 
second  wave  whose  optical  frequency  varies  from  point  to  points  a 
local  oscillator  <L0>  wave  whose  frequency  is  location  dependent. 
As  Turpin  notes,  the  space-dependent  frequency  of  this  wave  can  be 
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viewed  as  a  consequence  of  a  location-dependent  Doppler  shift: 
the  raster-scanned  spot  produces  in  the  output  plane  a  plane  wave 
that  tilts  rapidly  lef t— to-right  and  slowly  top— to— bottom.  The 
progressive  tilt  of  this  wave  with  time  produces  varying  amounts 
of  Doppler  shift  at  different  points  on  the  detector  surface. 

Over  a  small  local  region  of  the  detector  plane  where  the  LO  wave 
has  essentially  constant  Doppler  frequency  the  output  plane 

intensity  is  given  by 

*  2 

I(u,v,t)  =  I f  (t ) exp[-i2f*uJ  +  expCi 2TTVfttl  I 

-  1  +  If  <t)  I2, 

+  2  RejexpC— i2««ulf  (t>expC-i2r9„t  ]}  .  (9) 

If  this  intensity  is  integrated  with  respect  to  time  over  period 
T,  the  third  term  yields  a  spatial  sinusoid  whose  magnitude  and 
phase  are  governed  by  the  short-time  Fourier  spectrum  of  f(t): 

IF^  (>)*)  IcosC2smu  +  argjFT<'Jn)J  ]  (10) 

where 

FT<9n>  *  j  f  <t)expC-i2m)wt3dt.  (11) 

T 

If  T  exceeds  the  duration  of  f(t),  output  is  governed  by  the 
conventional  Fourier  spectrum.  By  looking  at  different  local 
regions  in  the  output  plane,  one  can  measure  the  magnitude  and 
phase  of  the  Fourier  spectrum  over  a  range  of  frequencies. 

(If  the  scanning  spot  in  Fig.  lOd  is  scanned 
acoustooptically,  there  is  an  additional  complicating  quirk:  the 
light  spot  is  i&sglf  shifted  in  frequency  as  it  scans.  In  this 
case  it  is  necessary  to  introduce  a  compensating  shift  in  the 
frequency  of  the  interfering  (signal)  wave.  The  result  is  a  chirp 
algorithm  implementation  of  the  Fourier  transform.  See,  for 
example,  C133.) 


C.  Moving  Cgmfe  FgastiSQ  Mgge£. 

Specific  characteristics  of  the  spatially  distributed  local 
oscillator  wave  can  be  analyzed  through  the  use  once  again  of  a 
spatial  comb  function,  this  time  one  that  is  translated  with 
constant  velocity.  The  comb  function  model  also  serves  to 
consolidate  the  distributed  local  oscillator  and  falling  raster 
points  of  view. 

Our  approach  to  modeling  the  raster— scanned  light  spot  is 
illustrated  in  Fig.  11.  In  Fig.  11a  we  show  a  linear  string  of 
impulses  being  translated  past  a  stationary  window.  Since  the 
impulse  spacing  equals  the  window  width,  there  is  always  a  single 
impulse  within  the  window  at  a  given  time,  and  con  :ant-velocity 
translation  of  the  impulse  string  results  in  a  single  falling- 
raster  scan  of  the  window.  In  Fig.  lib  it  is  a  2-D  comb  of 
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impulses  that  is  translated  past  the  window.  Again  there  is  only 
a  single  impulse  in  the  window  at  a  given  time,  but  translation  of 
the  comb  results  in  a  repetitive  falling  raster  scan  of  the 
window.  Me  choose  8  to  satisfy  the  condition 


tan6s  H/NW,  N  integer. 


(12) 


in  which  case  the  repetitive  raster  scan  is  truly  periodic — i.e. , 
subsequent  scans  retrace  previous  ones  exactly,  with  N  lines 
appearing  in  the  raster. 

Analytically  we  model  the  single  scan  of  Fig.  11a  by 


f  sc<w  (*,y*  t)  =  CR^(l/W>comb(x/W>S<y>]  **&<x-Vt,y>  j 


•  R^rect  <x/W,y/H>]  ,  <13> 

where  V  is  the  translational  velocity  in  the  x-direction.  The 
local  oscillator  distribution  corresponding  to  this  scan  is  given 
by  the  2-D  spatial  Fourier  transform  of  fSCAfi  <x,y;t>, 

F^^^  <u,  v;  t)  =  C  fZ^jcomb  <Wu>  1  <v>]  expC-i2TUVt] 

sinc(Wu*Hv)]  •  <14) 


Ignoring  for  the  moment  the  sinc-f unction  smoothing,  this  latter 
distribution  consists  of  line  impulses  oriented  as  in  Fig.  6b. 
Through  the  factor  expC-i2KUVt 3  the  temporal  frequency  of  the  wave 
amplitude  along  these  lines  is  shifted  in  proportion  to  u.  Thus 
there  is  a  continuous  range  of  local  oscillator  frequencies 
present  in  the  distribution.  As  was  true  for  the  space- 
integration  case  of  Fig  6d,  there  is  a  coarse  frequency  direction 
(in  the  u-direction>  and  a  fine  frequency  direction  (along  the 
impulse  lines).  The  separation  1/W  between  sine  function  nulls 
again  equals  the  line  impulse  spacing;  convolution  in  the 
direction  perpendicular  to  the  impulse  lines  thus  leads  to 
multiplu  temporal  frequencies  between  the  lines  but  not  on  the 
lines.  The  amount  of  convolution  blurring  in  the  fine— frequency 
direction  depends  on  the  window  length  H  and,  thereby,  on  the 
duration  of  the  scan.  At  any  point  along  one  of  these  lines, 
there  is  a  spread  of  frequencies  present  in  the  range  AV  *  1/T  * 
V/NW,  where  T  is  the  total  scan  time.  That  is,  of  course, 
consistent  with  the  observation  that  window  height  determines  how 
long  the  local  oscillator  wave  is  present  and  thus  determines 
spectral  resolution. 


The  periodic  raster  scan  of  Fig.  lib  is  modeled  by 


(16) 


88Can(x»y*t)  “  [R0^(l/WH)comb(x/W,y/H)$**i(x-Vt,y)] 
♦Rg^rect(x/W,y/H)^  , 

which  has  Fourier  transform 

Gscan^u,v;t^  “  [Rg^comb(Wu.Hv)]  exp[-i2«bVt] ] 

**R0(WH  sinc(Wu,Hv)\  .  (17) 


The  two  terms  entering  into  this  convolution  are  illustrated  in  Fig.  12.  The 
local  oscillator  distribution  consists  of  discrete  points  of  light,  separated 
in  temporal  frequency  ty  1/T  *  V/NW.  These  spots  are  blurred  by  the  sine 
function  convolution,  but  in  such  a  way  that  their  discrete-frequency  local 
oscillator  character  is  preserved  at  the  spot  centers.  Those  spots  contained 
within  the  dashed  lines  of  Fig.  12  span  the  entire  range  of  frequencies 
available . 
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